-- Logs begin at Wed 2022-08-10 09:22:20 UTC, end at Wed 2022-08-10 10:20:33 UTC. -- Aug 10 09:54:58.063255 dv-cinder-850836-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 09:54:58.070750 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 09:54:58 2022] *** Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: nodename: dv-cinder-850836-5-iscsi Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: machine: x86_64 Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: clock source: unix Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: pcre jit disabled Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: detected number of CPU cores: 4 Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: current working directory: / Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: detected binary path: /usr/bin/uwsgi-core Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: your processes number limit is 47680 Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: your memory page size is 4096 bytes Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: detected max file descriptor number: 2048 Aug 10 09:54:58.073803 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: lock engine: pthread robust mutexes Aug 10 09:54:58.074602 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: thunder lock: enabled Aug 10 09:54:58.074602 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 09:54:58.074602 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 09:54:58.113300 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: Python main interpreter initialized at 0x5571635719c0 Aug 10 09:54:58.113300 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: python threads support enabled Aug 10 09:54:58.113300 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: your server socket listen backlog is limited to 100 connections Aug 10 09:54:58.113300 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: your mercy for graceful operations on workers is 90 seconds Aug 10 09:54:58.113655 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 09:54:58.113731 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: *** Operational MODE: preforking *** Aug 10 09:54:58.113947 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: *** uWSGI is running in multiple interpreter mode *** Aug 10 09:54:58.113947 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: spawned uWSGI master process (pid: 103242) Aug 10 09:54:58.114141 dv-cinder-850836-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 09:54:58.115538 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: spawned uWSGI worker 1 (pid: 103243, cores: 1) Aug 10 09:54:58.115538 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: spawned uWSGI worker 2 (pid: 103244, cores: 1) Aug 10 09:54:58.115538 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 09:54:58.767174 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 09:54:58.771504 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 09:54:59.841773 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:54:59.841773 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: from cryptography.utils import int_from_bytes Aug 10 09:54:59.842334 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:54:59.842334 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: from cryptography.utils import int_from_bytes Aug 10 09:54:59.842702 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:54:59.842702 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: from cryptography.utils import int_from_bytes Aug 10 09:54:59.842812 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:54:59.842812 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: from cryptography.utils import int_from_bytes Aug 10 09:55:02.312346 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 09:55:02.312866 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 09:55:02.312951 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 09:55:02.313276 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 09:55:02.313379 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 09:55:02.313629 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 09:55:02.313746 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 09:55:02.313869 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 09:55:02.313982 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 09:55:02.314236 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 09:55:02.314316 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.314556 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.314659 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.314974 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.315072 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.315213 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.315457 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.315594 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.315784 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.315892 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.316118 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.316222 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.316433 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.316537 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.316749 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.316852 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.316996 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.317084 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.317305 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.317409 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.317626 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-5-iscsi {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.317734 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.317940 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.318038 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.318239 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.318337 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-5-iscsi {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.318541 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.318629 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.318851 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.319008 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.319177 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.319265 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.319493 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.319579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.319791 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.319889 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.320160 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.320298 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.320424 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.320731 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.320906 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.321068 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.321209 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.321492 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.321600 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.321679 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.321774 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.321949 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.322107 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.322252 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.322420 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.322585 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.322725 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.322853 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.323195 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.323307 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.323501 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.323635 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.323858 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.323963 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-5-iscsi {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.324170 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.324283 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.324481 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.324577 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-5-iscsi {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.324790 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.324902 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.325158 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.325251 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.325469 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.325581 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.325771 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.325861 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.326086 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.326177 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.326402 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.326509 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.326703 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.326795 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.327046 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.327203 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.327353 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.327492 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.327660 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.327804 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.327977 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.328129 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.328274 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.328407 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.328555 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.328697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.328837 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.329473 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.329663 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.329795 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.329966 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.330109 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.330259 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.330386 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.330531 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.330695 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.330841 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.331009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.331165 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.331310 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.331447 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.331680 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.331824 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.331964 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.332102 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.332250 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.332388 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.332533 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.332681 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.332818 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.332962 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.333091 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.333174 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.333318 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.333430 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.333622 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.333726 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.333924 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.334018 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.334222 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.334323 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.334527 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.334701 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.334843 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.335061 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.335223 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.335436 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.335591 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.335694 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.335774 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.335850 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.336018 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.336104 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.336334 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.336420 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.336632 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.336717 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.336935 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.337018 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.337256 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.337354 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.337557 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.337642 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.337859 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.337952 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.338179 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.338262 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.338492 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.338583 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.338792 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.338889 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.339129 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.339445 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.339540 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.339746 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.339831 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.340046 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.340133 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.340344 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.340475 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.340657 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.340749 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.340983 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.341069 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.341289 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.341380 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.341534 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.341627 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.341826 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.341914 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.342121 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.342213 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.342432 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.342532 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.342729 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.342825 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.343069 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.343249 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.343380 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.343568 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.343697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.343868 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.343994 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.344172 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.344297 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.344477 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.344625 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.345342 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.345559 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.345685 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.345806 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.345934 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.346055 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.346226 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.346353 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.346527 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.346636 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.346827 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.346932 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.347175 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.347282 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.347448 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.347543 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.347763 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.347857 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.348063 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.348147 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.348361 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.348455 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.348658 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.348741 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.348953 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.349045 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.349252 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.349345 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.349552 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.349644 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.349850 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.349937 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.350145 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.350246 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.350448 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.350579 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.350746 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.350831 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.351068 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.351271 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.351484 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.351680 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.351886 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.352090 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.352277 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.352486 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.352677 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.352870 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.353066 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.353260 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.353532 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.353750 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.353956 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.354171 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.354376 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.354592 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.354810 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.355064 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.355297 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.355448 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.355608 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.355753 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.355917 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.356061 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.356209 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.356355 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.356499 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.356644 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.356801 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.356957 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.357093 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.357268 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.357407 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.357552 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.357710 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.357852 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.358001 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.358143 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.358289 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.358449 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.358608 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.358761 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.358905 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:55:02.359289 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.359518 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.359750 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.359956 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.360162 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.360398 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.360601 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.360803 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.361019 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.361221 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.361221 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.361556 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.361681 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.361813 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.361937 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.362060 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.362215 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.362423 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.362626 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.362810 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.362938 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363092 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363216 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363347 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363470 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363606 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363729 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363729 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.363973 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.364191 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.364325 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.364461 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.364588 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.364710 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.364838 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.364967 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365090 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365227 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365351 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365481 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365615 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365745 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365867 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.365998 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366088 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366166 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366241 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366317 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366400 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366485 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366562 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366650 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366728 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366804 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.366894 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367010 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367167 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367294 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367423 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367558 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367682 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367805 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.367933 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.368055 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.368183 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.368313 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.368436 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.368565 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.368687 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.369075 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.369221 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.369414 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.369540 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.369665 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.369786 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.369944 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.370090 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.370251 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.370384 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.370557 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.370684 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.370862 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.371036 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.371206 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.371339 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.371517 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.371651 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.371825 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.371959 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.372130 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.372254 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.372439 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.372561 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.372743 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.372875 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.373046 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.373170 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.373346 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.373477 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.373644 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.373769 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.373945 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.374074 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.374245 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.374368 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.374545 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.374671 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.374844 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.375006 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.375183 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.375319 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.375505 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.375633 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.375806 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.375957 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.376141 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.376268 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.376447 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.376580 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.376752 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.376879 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.377053 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.377328 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.377476 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.377599 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.377721 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.377849 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.377971 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.378105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.378231 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.378360 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.378505 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.378598 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.378824 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.378924 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.379170 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.379349 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.379558 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.379683 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.379807 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.379963 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.380095 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.380266 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.380394 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.380568 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.380707 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.380878 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.381005 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.381190 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.381326 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.381501 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.381713 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.381913 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.382104 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.382299 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.382498 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.382712 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.382921 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.383204 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.383570 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.383794 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.384025 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.384235 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.384400 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.384552 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.384774 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.384940 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.385088 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.385242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.385385 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.385604 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.385754 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.385902 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.386060 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.386230 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.386393 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.386537 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.386676 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.386835 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.387014 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.387247 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.387429 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.387615 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.387815 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.388015 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.388198 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.388495 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.388691 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.388691 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.389039 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.389234 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.389442 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.389750 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.389941 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.390141 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.390336 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.390546 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.390765 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.390901 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.391100 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.391254 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.391459 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.392221 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.392444 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.392599 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.392752 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.392890 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.392890 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393157 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393302 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393302 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393561 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393696 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393831 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393977 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.393977 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.394234 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.394369 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.394519 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.394655 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.394805 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.394943 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.395108 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.395244 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.395379 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.395514 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.395661 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.395799 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.395936 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.396073 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.396216 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.396365 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.396365 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.396633 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.396769 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.396915 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397060 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397060 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397060 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397060 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397060 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397698 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397698 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.397970 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.398149 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.398457 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.398766 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400250 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400367 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400461 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400461 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400593 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400660 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400724 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400787 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400858 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400923 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.400986 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.401056 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.401120 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.401189 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.401393 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.401489 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.401777 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.402019 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.402112 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.402363 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.402464 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.402683 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.402778 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.403005 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.403264 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.403365 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.403589 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.403680 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.403920 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.404038 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.404247 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.404431 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.404567 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.404746 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.407016 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.407171 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.407248 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.407848 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.407921 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.407985 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408049 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408120 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408195 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408262 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408326 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408389 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408459 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408525 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408607 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408675 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408739 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408802 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408865 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.408929 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409000 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409067 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409130 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409225 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409540 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409642 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409872 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.409967 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.410197 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.410305 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.410564 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.410713 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.410884 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.411056 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.411225 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.411372 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.411923 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.412113 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.412263 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.412424 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.412802 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.413377 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.413457 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.413534 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.413808 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.413893 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.413960 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.414023 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.414262 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.414405 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.414581 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.414710 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.414892 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.415116 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.415261 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.415392 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.415521 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.415664 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.415827 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.415929 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.416144 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.416227 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.416458 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.416548 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.416768 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.416861 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.417080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.417172 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.417385 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.417469 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.417693 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.417785 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.418003 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.418088 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.418307 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.418398 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.418622 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.418718 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.418930 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.419029 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.419263 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.419376 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.419568 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.419665 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.419867 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.419965 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.420181 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.420268 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.420515 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.420768 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.420856 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.421103 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.421191 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.421421 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.421523 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.421731 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.421815 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.422047 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.422141 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.422356 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.422460 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.422686 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.422809 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.423154 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.423253 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.423470 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.423560 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.423780 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.423877 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.424090 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.424179 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.424403 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.424505 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.424715 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.424812 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.425023 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.425111 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.425338 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.425434 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.425646 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.425746 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.425947 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.426044 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.426253 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.426347 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.426553 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.426639 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.426857 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.426985 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.427199 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.427334 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.427644 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.427776 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.427959 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.428109 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.428267 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.428425 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.428579 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.428743 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.428886 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.429068 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.429216 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.429384 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.429545 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.429716 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.429834 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.430041 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.430137 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.430378 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.430473 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.430708 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.430796 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.431055 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.431150 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.431366 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.431455 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.431676 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.431763 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432033 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432134 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432292 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432376 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432597 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432694 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432903 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.432989 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.433213 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.433304 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.433514 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.433599 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.433816 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.433912 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.434120 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.434215 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.434425 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.434569 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.434729 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.434831 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.435062 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.435235 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.435380 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.435559 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.435700 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.435909 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.436048 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.436174 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.436308 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.436479 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.436567 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.436786 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.436881 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.437090 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.437177 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.437399 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.437495 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.437709 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.437795 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.438011 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.438098 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.438320 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.438436 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.438651 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.438738 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.439007 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.439241 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.439329 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.439556 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.439644 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.439864 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.439951 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.440170 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.440264 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.440481 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.440593 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.440784 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.440884 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.441085 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.441182 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.441390 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.441474 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.441694 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.441779 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.441993 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.442084 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.442304 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.442398 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.442605 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.442699 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.442910 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.443045 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.443246 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.443549 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.443853 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.443970 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.444161 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.444290 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.444486 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.444615 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.444805 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.444930 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.445098 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.445255 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.445400 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.445572 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.445703 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.445941 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.446063 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.446186 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.446282 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.446499 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.446593 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.446809 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.446912 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.447143 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.447465 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.447774 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.448078 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.448173 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.448250 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.448388 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.448554 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.448693 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.448868 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.449024 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.449189 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.449501 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.449818 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.450034 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.450124 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.450365 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451104 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451190 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451279 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451366 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451444 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451529 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451609 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451685 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451761 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.451927 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.452238 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.452546 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.452780 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.452864 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.453080 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.453175 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.453401 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.453562 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.453700 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.453839 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.454539 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.454678 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.454853 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.455015 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.455189 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.455496 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.455802 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.456177 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.456486 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.456791 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.456929 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.457095 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.457227 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.457397 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.457544 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.457688 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.457830 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.458015 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.458154 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.458322 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.458469 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.458611 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.458747 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.458915 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.459125 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.459271 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.459405 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.459571 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.459662 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.459873 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.459968 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.460233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.460327 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.460538 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.460625 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.460854 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.460940 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.461172 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.461259 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.461489 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.461585 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.461802 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.461888 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.462113 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.462200 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.462418 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.462518 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.462726 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.462825 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.463055 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.463160 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.463370 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.463674 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.463976 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.464103 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.464299 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.464429 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.464608 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.464751 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.464917 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.465073 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.465239 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.465389 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.465563 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.465722 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.465887 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.466039 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.466208 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.466351 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.466493 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.466664 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.466801 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.466990 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.467153 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.467310 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.467462 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.467619 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.467776 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.468058 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.468158 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.468372 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.468461 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.468681 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.468782 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.468984 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.469069 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.469288 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.469373 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.469608 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.470226 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.470445 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.470544 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.470754 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.470841 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.471138 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.471253 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.471407 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.471507 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.471715 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.471810 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.472018 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.472118 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.472325 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.472409 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.472627 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.472721 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.472934 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.473030 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.473237 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.473330 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.473591 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.473699 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.473897 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.473992 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.474202 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.474297 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.474506 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.474608 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.474832 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.475023 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.475153 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.475356 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.475456 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.475686 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.475770 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.476125 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.476268 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.476413 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.476547 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.476689 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.476824 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.477059 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.477477 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.477791 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.477875 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.478102 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.478258 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.478450 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.478785 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.479146 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.479323 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.479464 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.479598 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.479776 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.479933 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.480077 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.480220 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.480388 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.480530 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.480715 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.480857 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.481041 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.481198 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.481334 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.481468 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.481645 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.481789 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.481934 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.482078 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.482262 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.482418 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.482585 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.482777 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.482921 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.483117 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.483275 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.483419 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.483681 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.483842 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.483990 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.484126 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.484269 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.484405 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.484590 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.484732 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.484914 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.485056 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.485235 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.485381 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.485552 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.485694 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.485863 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.486015 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.486162 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.486299 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.486456 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.486597 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.486779 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.486927 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.487123 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.487275 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.487417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.487550 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.487728 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.487885 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.488031 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.488165 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.488327 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.488476 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.488632 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.488845 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.488984 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.489126 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.489262 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.489397 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.489530 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.489675 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.489844 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.489996 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.490166 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.490314 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.490490 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.490639 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.490796 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.490936 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.491189 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.491328 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.491475 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.491611 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.491744 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.491877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.492022 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.492157 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.492324 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.492469 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.492658 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.492808 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.492945 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.493077 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.493464 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.493618 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.494029 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.494239 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.494399 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.494543 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.494688 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.494823 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.494981 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.495134 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.495271 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.495418 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.495584 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.495727 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.495869 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496003 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496137 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496303 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496440 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496579 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496715 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496849 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.496991 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.497140 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.497275 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.497408 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.497541 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.497675 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.497817 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.497965 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.498111 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.498244 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.498378 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.498511 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.498658 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.498794 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.498928 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.499096 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.499289 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.499432 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.499576 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.499712 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.499901 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.500043 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.500213 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.500354 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.500501 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.500637 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.500804 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.500979 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.501115 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.501298 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.501461 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.501603 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.501766 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.501919 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.502079 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.502228 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.502385 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.502539 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.502696 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.502837 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.503019 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.503180 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.503324 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.503459 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.503615 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.503756 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.503937 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.504090 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.504243 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.504450 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.504590 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.504731 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.504865 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.505006 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.505142 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.505282 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.505417 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.505557 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.505700 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.505845 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.506026 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.506178 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.506321 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.506571 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.506726 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.506897 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.507064 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.507238 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.507380 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.507550 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.507704 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.507860 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.507956 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.508172 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.508314 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.508481 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.508611 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.508788 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.508917 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.509096 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.509233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.509405 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.509535 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.509712 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.509859 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.510040 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.510169 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.510360 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.510495 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.510681 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.510810 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.511043 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.511253 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.511395 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.511585 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.511671 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.511900 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.511984 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.512212 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.512298 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.512523 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.512615 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.512834 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.512919 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.513150 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.513266 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.513457 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.513562 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.513766 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.513868 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.514072 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.514168 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.514379 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.514481 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.514692 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.514808 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.515030 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.515253 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.515371 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.515589 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.515676 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.515930 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.516024 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.516241 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.516327 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.517086 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.517190 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.517400 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.517484 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.517716 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.517808 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.518033 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.518181 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.518345 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.518438 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.518655 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.518741 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.518991 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.519311 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.519624 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.519935 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.520242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.520334 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522013 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522126 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522220 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522300 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522378 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522378 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522527 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522601 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522672 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522749 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522824 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.522901 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523040 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523126 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523204 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523280 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523364 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523488 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523598 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523807 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.523905 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.524122 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.524217 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.524453 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.524643 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.524752 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.524956 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.525061 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.525285 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.525390 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.525610 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.525704 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.525934 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.526027 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.526249 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.526343 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.526565 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.526790 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.527150 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.527265 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.527477 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.527807 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.528063 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.528166 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.528456 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.528671 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.528913 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.529116 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.529323 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.529532 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.529733 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.529976 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.530238 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.530445 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.530688 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.530890 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.531203 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.531505 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.531713 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.531956 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.532721 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.532930 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.533134 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.533134 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.533507 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.533678 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.533852 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.533995 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.534133 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.534430 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.534578 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.534716 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.534854 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.535153 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.535336 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.535491 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.535633 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.535783 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.535922 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.536059 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.536059 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.536379 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.536519 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.536659 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.536797 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.536936 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.537082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.537222 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.537360 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.537511 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.537662 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.537802 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.537949 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.538115 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.538400 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.538548 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.538696 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.538835 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.539077 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.539225 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.539364 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.539511 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.539651 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.539810 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.539950 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.540090 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.540228 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.540366 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.540504 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.540650 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.540791 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.540930 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.541074 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.541212 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.541357 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.541509 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.541707 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.541849 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.541987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.542125 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.542270 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.542418 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.542566 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.542713 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.542713 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.543009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.543167 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.543315 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.543453 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.543601 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.543746 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.543968 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.544118 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.544264 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.544408 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.544542 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.544680 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.544817 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.544962 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545121 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545255 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545339 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545418 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545496 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545584 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545665 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545751 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545831 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545910 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.545998 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546085 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546164 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546243 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546322 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546400 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546486 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546486 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546631 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546709 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546794 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.546874 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.547049 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.547334 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.547450 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.547651 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.547787 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.547988 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.549066 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.549066 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.549066 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.549066 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.549545 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.549754 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.549892 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550020 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550145 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550278 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550404 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550537 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550663 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550801 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.550936 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.551102 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.551228 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.551373 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.551513 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.551679 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.551806 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.551931 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552063 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552189 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552315 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552438 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552574 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552712 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552850 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.552977 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.553127 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.553266 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.553441 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.553570 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.553935 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.554077 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.554203 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.554328 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.554453 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.554591 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.554725 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.554876 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.555058 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.555277 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.555417 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.555552 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.555678 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.555847 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.555977 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.556158 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.556288 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.556479 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.556619 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.556789 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.556912 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.557260 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.557380 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.557489 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.557595 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.557759 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.557874 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.558982 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559265 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559356 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559444 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559534 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559625 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559706 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559794 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559875 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.559954 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560032 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560110 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560197 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560278 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560364 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560451 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560540 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560628 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560723 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.560896 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.561024 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.561237 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.561331 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.561568 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.561664 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.561895 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.561986 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.562199 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.562285 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.562541 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.562645 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.562804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.562890 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.563130 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.563220 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.563460 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.563553 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.563763 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.563872 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.564065 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.564181 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.564371 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.564484 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.564670 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.564793 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.564975 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.565097 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.565277 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.565426 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.565583 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.565692 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.565882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.565995 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.566216 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.566304 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.566551 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.566637 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.566863 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.566982 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.567194 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.567281 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.567499 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.567586 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.567801 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.567903 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.568104 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.568191 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.568416 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.568502 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.568719 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.568813 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.569022 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.569110 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.569336 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.569422 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.569615 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.569713 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.569917 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.570006 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.570234 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.570320 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.570543 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.570632 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.570850 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.570938 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.571193 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.571310 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.571504 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.571595 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.571826 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.571914 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.572134 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.572231 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.572445 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.572532 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.572764 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.572857 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.573076 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.573171 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.573384 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.573471 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.573696 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.573789 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.574006 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.574101 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.574314 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.574401 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.574624 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.574712 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.574929 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.575051 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.575259 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.575347 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.575564 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.575650 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.575875 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.575964 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.576189 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.576276 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.576493 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.576578 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.576799 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.576891 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.577117 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.577235 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.577426 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.577531 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.577750 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.577841 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.578067 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.578160 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.578373 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.578458 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.578698 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.578793 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.579534 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.579629 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.579844 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.579955 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.580154 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.580241 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.580464 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.580550 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.580778 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.580871 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.581088 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.581173 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.581398 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.581483 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.581712 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.581805 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.581961 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 09:55:02.582048 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.582336 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.582666 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.582994 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.583324 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.583651 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.584000 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.584311 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.584656 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.584986 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.585301 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.585616 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.585920 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:55:02.586163 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 09:55:02.735599 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO dbcounter [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Registered counter for database nova_api Aug 10 09:55:02.740836 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Registered counter for database nova_api Aug 10 09:55:02.756874 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_db.sqlalchemy.engines [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:02.761008 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:02.763490 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writer thread running {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:02.768206 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:02.818477 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.context [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e525c749-c7e5-42c0-b469-97038053e8e5(cell1) {{(pid=103243) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 09:55:02.822241 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_concurrency.lockutils [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 09:55:02.822709 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_concurrency.lockutils [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 09:55:02.823183 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.context [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e525c749-c7e5-42c0-b469-97038053e8e5(cell1) {{(pid=103244) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 09:55:02.824301 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_concurrency.lockutils [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 09:55:02.825020 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_concurrency.lockutils [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 09:55:02.825461 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_concurrency.lockutils [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 09:55:02.827011 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 09:55:02.827446 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_concurrency.lockutils [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 09:55:02.827535 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 09:55:02.829639 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 09:55:02.829969 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO dbcounter [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Registered counter for database nova_cell0 Aug 10 09:55:02.830372 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 09:55:02.830819 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 09:55:02.832832 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 09:55:02.834809 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Registered counter for database nova_cell0 Aug 10 09:55:02.835276 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO dbcounter [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Registered counter for database nova_cell1 Aug 10 09:55:02.840229 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Registered counter for database nova_cell1 Aug 10 09:55:02.843182 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_db.sqlalchemy.engines [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:02.845138 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_db.sqlalchemy.engines [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:02.847261 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:02.850707 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writer thread running {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:02.850936 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:02.853455 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writer thread running {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:02.854272 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:02.990425 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:02.994597 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO dbcounter [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Registered counter for database nova_cell0 Aug 10 09:55:02.999520 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO dbcounter [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Registered counter for database nova_cell0 Aug 10 09:55:03.002201 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG oslo_db.sqlalchemy.engines [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:03.006495 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writer thread running {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:03.008912 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_db.sqlalchemy.engines [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:55:03.013370 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writer thread running {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:55:03.341057 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: WARNING keystonemiddleware.auth_token [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 09:55:03.341567 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 09:55:03.348227 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: WARNING keystonemiddleware.auth_token [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 09:55:03.348495 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 09:55:03.686818 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: WARNING keystonemiddleware.auth_token [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 09:55:03.688428 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 09:55:03.692706 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: WARNING keystonemiddleware.auth_token [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 09:55:03.694354 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: WARNING keystonemiddleware.auth_token [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 09:55:03.697941 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571635719c0 pid: 103243 (default app) Aug 10 09:55:03.699627 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571635719c0 pid: 103244 (default app) Aug 10 09:55:03.700006 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:55:03.701172 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e7301dca-0ee5-4625-8886-bf9b92bed32b None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001699 Aug 10 09:55:03.701578 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Aug 10 09:55:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:18.520238 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:18.521426 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Aug 10 09:56:18.521821 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:18.535231 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writing DB stats nova_api:SELECT=3 {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:18.536487 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writing DB stats nova_cell0:SELECT=3 {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:18.537593 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writing DB stats nova_cell1:SELECT=3 {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:18.538416 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:19.382308 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-c2b6e2b9-061a-467c-a78b-d0f1f121df68 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:19.421167 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-c2b6e2b9-061a-467c-a78b-d0f1f121df68 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893081 Aug 10 09:56:19.422326 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 10 09:56:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 09:56:21.609559 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:21.611804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-dfecf546-20d3-4595-9b11-357da073bb14 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002271 Aug 10 09:56:21.612833 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:22.064279 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-aac9abaf-b4e0-4688-ad51-044697aa482b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:22.086510 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:56:22.086510 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: warnings.warn(msg) Aug 10 09:56:22.116503 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-aac9abaf-b4e0-4688-ad51-044697aa482b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497918 Aug 10 09:56:22.125020 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:56:22.340563 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-765e93d8-815f-4c31-b4d8-94eaa5a7babf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:22.345394 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:56:22.345394 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Aug 10 09:56:22.348138 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=3 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:22.348905 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell0:SELECT=3 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:22.350041 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell1:SELECT=3 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:22.350878 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:22.419071 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-765e93d8-815f-4c31-b4d8-94eaa5a7babf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291669 Aug 10 09:56:22.419791 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 10 09:56:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:56:24.627958 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-aac9abaf-b4e0-4688-ad51-044697aa482b admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:24.629036 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-aac9abaf-b4e0-4688-ad51-044697aa482b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 10 09:56:24.629464 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:25.275091 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-463e9b1e-6070-4e79-895d-20d54ba9c612 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "name": "ds512M", "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:25.297395 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:56:25.297395 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Aug 10 09:56:25.319545 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-463e9b1e-6070-4e79-895d-20d54ba9c612 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683836 Aug 10 09:56:25.320758 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:56:25.333164 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-8c9cc05a-47e8-4232-b7ef-b43056346abb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:25.336764 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:56:25.336764 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: warnings.warn(msg) Aug 10 09:56:25.375664 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-8c9cc05a-47e8-4232-b7ef-b43056346abb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046640 Aug 10 09:56:25.376448 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 10 09:56:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:56:27.628274 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-463e9b1e-6070-4e79-895d-20d54ba9c612 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:27.629826 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-463e9b1e-6070-4e79-895d-20d54ba9c612 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Aug 10 09:56:27.630994 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:28.033451 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6833e0fa-5d1e-4bcd-9e21-4e884a592403 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G"}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:28.053810 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-6833e0fa-5d1e-4bcd-9e21-4e884a592403 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.417754 Aug 10 09:56:28.054278 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 09:56:28.067741 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-a521f600-3ab4-4295-85c6-2f47f9d0c5dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:28.094135 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-a521f600-3ab4-4295-85c6-2f47f9d0c5dc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030138 Aug 10 09:56:28.094717 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 10 09:56:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:56:30.326298 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6833e0fa-5d1e-4bcd-9e21-4e884a592403 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:30.328334 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-6833e0fa-5d1e-4bcd-9e21-4e884a592403 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001984 Aug 10 09:56:30.329137 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:30.753014 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-dbd423bb-bde0-4284-ba98-84cd404509fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "swap": 0}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:30.776939 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-dbd423bb-bde0-4284-ba98-84cd404509fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442067 Aug 10 09:56:30.777576 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 09:56:30.789874 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-b78bf563-c271-4a08-9419-e52de37ac800 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:30.825156 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-b78bf563-c271-4a08-9419-e52de37ac800 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038903 Aug 10 09:56:30.825801 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 10 09:56:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:56:33.133320 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-dbd423bb-bde0-4284-ba98-84cd404509fe admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:33.134332 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-dbd423bb-bde0-4284-ba98-84cd404509fe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 10 09:56:33.134731 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:33.564059 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-8ff13233-89dc-402a-9cdc-ef4338c6b84c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "ram": 4096}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:33.585028 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-8ff13233-89dc-402a-9cdc-ef4338c6b84c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443890 Aug 10 09:56:33.585574 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:56:33.597441 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-0450000c-d598-4dbd-bc7a-1052ab41dcd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:33.622072 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-0450000c-d598-4dbd-bc7a-1052ab41dcd8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028249 Aug 10 09:56:33.622631 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1336 bytes} [Wed Aug 10 09:56:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 09:56:35.851066 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-8ff13233-89dc-402a-9cdc-ef4338c6b84c admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:35.852034 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-8ff13233-89dc-402a-9cdc-ef4338c6b84c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 10 09:56:35.852424 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:36.294444 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-535b4bb5-2ba5-4f49-a093-879dfbe9d400 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:36.319384 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-535b4bb5-2ba5-4f49-a093-879dfbe9d400 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460948 Aug 10 09:56:36.319921 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 10 09:56:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 09:56:38.488376 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-8ff13233-89dc-402a-9cdc-ef4338c6b84c admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:38.489435 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-8ff13233-89dc-402a-9cdc-ef4338c6b84c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 10 09:56:38.489763 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:38.915059 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d6687655-2573-4df5-955c-6667960d4a72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:38.936156 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d6687655-2573-4df5-955c-6667960d4a72 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.438365 Aug 10 09:56:38.936651 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:56:38.949151 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6fa67fdc-e934-4028-ac97-b65daa72aba1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:38.973102 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-6fa67fdc-e934-4028-ac97-b65daa72aba1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027564 Aug 10 09:56:38.973927 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 10 09:56:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:56:41.139116 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d6687655-2573-4df5-955c-6667960d4a72 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:41.140173 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d6687655-2573-4df5-955c-6667960d4a72 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 10 09:56:41.140579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:41.559539 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-a5d38a62-e50f-44ba-a616-21e32ff3ae05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:41.578725 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-a5d38a62-e50f-44ba-a616-21e32ff3ae05 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.432285 Aug 10 09:56:41.579311 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 09:56:41.591263 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-766845c7-2659-4437-af00-a6303df0f97f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:41.614554 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-766845c7-2659-4437-af00-a6303df0f97f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027031 Aug 10 09:56:41.615120 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 10 09:56:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:56:43.848741 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-a5d38a62-e50f-44ba-a616-21e32ff3ae05 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:43.849777 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-a5d38a62-e50f-44ba-a616-21e32ff3ae05 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 Aug 10 09:56:43.850195 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:44.250165 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-c26e9300-3162-4784-a143-5affdf9e8d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "3", "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:44.269611 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-c26e9300-3162-4784-a143-5affdf9e8d6a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.412884 Aug 10 09:56:44.270405 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:56:44.283068 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-56e3c1ff-e45f-412e-a465-802eaab89603 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:44.307047 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-56e3c1ff-e45f-412e-a465-802eaab89603 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028096 Aug 10 09:56:44.307629 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 10 09:56:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:56:46.539196 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-c26e9300-3162-4784-a143-5affdf9e8d6a admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:46.540217 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-c26e9300-3162-4784-a143-5affdf9e8d6a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 10 09:56:46.540612 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:47.032432 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-230b343e-5d2f-4a2e-9950-58f413fdbbb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:47.053063 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-230b343e-5d2f-4a2e-9950-58f413fdbbb0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506420 Aug 10 09:56:47.053601 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 09:56:47.066974 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-9b8d57bc-b237-468e-8abf-0b8cae031b70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:47.094933 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-9b8d57bc-b237-468e-8abf-0b8cae031b70 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031183 Aug 10 09:56:47.096268 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 10 09:56:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 09:56:49.319854 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-230b343e-5d2f-4a2e-9950-58f413fdbbb0 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:56:49.321463 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-230b343e-5d2f-4a2e-9950-58f413fdbbb0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Aug 10 09:56:49.322214 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:56:49.760849 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d2664150-a5fd-4b01-8685-dd4d1d385f97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "swap": 0}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:49.782235 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d2664150-a5fd-4b01-8685-dd4d1d385f97 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454445 Aug 10 09:56:49.785737 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1283 bytes} [Wed Aug 10 09:56:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:56:49.796921 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-d026ecdf-83b4-4d20-8d1f-084ff2cf20e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:56:49.801897 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:49.826797 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-d026ecdf-83b4-4d20-8d1f-084ff2cf20e9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033615 Aug 10 09:56:49.828157 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1333 bytes} [Wed Aug 10 09:56:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:57:10.224752 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d2664150-a5fd-4b01-8685-dd4d1d385f97 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:10.225751 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d2664150-a5fd-4b01-8685-dd4d1d385f97 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 10 09:57:10.226146 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:57:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:10.237304 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:10.610015 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e9aaf196-63c1-45e0-aec5-ba5ad6cf1f75 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:10.628003 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e9aaf196-63c1-45e0-aec5-ba5ad6cf1f75 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396043 Aug 10 09:57:10.628533 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 10 09:57:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 09:57:11.681740 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d2664150-a5fd-4b01-8685-dd4d1d385f97 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:11.682728 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d2664150-a5fd-4b01-8685-dd4d1d385f97 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 10 09:57:11.683155 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:12.189725 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-02096050-7b58-4d77-aa21-a27daa8eb831 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:12.195212 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.wsgi [None req-02096050-7b58-4d77-aa21-a27daa8eb831 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-02096050-7b58-4d77-aa21-a27daa8eb831 admin admin] Request method failure captured: Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Accept: application/json Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Accept-Encoding: gzip, deflate Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Connection: keep-alive Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Content-Length: 0 Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Host: 10.222.0.20 Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Openstack-Api-Version: compute 2.90 Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Openstack-System-Scope: None Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: User-Agent: python-novaclient Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Auth-Token: gAAAAABi84D3hhmvqZgK0cEgWpZfUxN1Y4np2PIR329xkU_0AEJWt1xlxrfcri-_hHXg2OWenUl-gNXPDQxH6-OIdYEOPgJbKSmXu9mxeuMWhkT3Tf-ZNIJTeVjjEwXekBTw-LuGgyLvOL7Ssryss2TbYHPAHAg5tYrWjZewUZAV7qP_47lAhzM Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Domain-Id: None Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Domain-Name: None Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Identity-Status: Confirmed Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Is-Admin-Project: True Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Domain-Id: default Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Domain-Name: Default Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Name: admin Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Role: admin,reader,member Aug 10 09:57:12.198399 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Roles: admin,reader,member Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}] Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant: admin Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant-Name: admin Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User: admin Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Domain-Id: default Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Domain-Name: Default Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Id: 2ff7daf364734feb8aab110b9b2ef63b Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Name: admin Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: method: > Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: exception: Flavor 42 could not be found. Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: action_args: {'id': '42'} Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 09:57:12.199948 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:12.200882 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.202009 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-02096050-7b58-4d77-aa21-a27daa8eb831 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 09:57:12.203617 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-02096050-7b58-4d77-aa21-a27daa8eb831 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.380160 Aug 10 09:57:12.203617 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 10 09:57:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:12.209887 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-69faf924-bc74-4478-9620-eadc27ab5c73 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:12.214053 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:12.233491 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-69faf924-bc74-4478-9620-eadc27ab5c73 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027098 Aug 10 09:57:12.233991 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 10 09:57:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 09:57:12.243607 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-3dabe2de-ce30-4802-8ce1-22cd4c892721 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:12.268728 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-3dabe2de-ce30-4802-8ce1-22cd4c892721 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028600 Aug 10 09:57:12.269257 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 10 09:57:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 09:57:12.278648 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-563daab0-6bee-43ac-8e18-437c43a7b24d admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:12.285371 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.wsgi [None req-563daab0-6bee-43ac-8e18-437c43a7b24d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-563daab0-6bee-43ac-8e18-437c43a7b24d admin admin] Request method failure captured: Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Accept: application/json Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Accept-Encoding: gzip, deflate Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Connection: keep-alive Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Content-Length: 0 Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Host: 10.222.0.20 Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Openstack-Api-Version: compute 2.90 Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Openstack-System-Scope: None Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: User-Agent: python-novaclient Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Auth-Token: gAAAAABi84D3hhmvqZgK0cEgWpZfUxN1Y4np2PIR329xkU_0AEJWt1xlxrfcri-_hHXg2OWenUl-gNXPDQxH6-OIdYEOPgJbKSmXu9mxeuMWhkT3Tf-ZNIJTeVjjEwXekBTw-LuGgyLvOL7Ssryss2TbYHPAHAg5tYrWjZewUZAV7qP_47lAhzM Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Domain-Id: None Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Domain-Name: None Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Identity-Status: Confirmed Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Is-Admin-Project: True Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Domain-Id: default Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Domain-Name: Default Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Name: admin Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Role: admin,reader,member Aug 10 09:57:12.288579 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Roles: admin,reader,member Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}] Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant: admin Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant-Name: admin Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User: admin Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Domain-Id: default Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Domain-Name: Default Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Id: 2ff7daf364734feb8aab110b9b2ef63b Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Name: admin Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: method: > Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: exception: Flavor 42 could not be found. Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: action_args: {'id': '42'} Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 09:57:12.290093 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:12.291080 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:12.292350 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-563daab0-6bee-43ac-8e18-437c43a7b24d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 09:57:12.293541 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-563daab0-6bee-43ac-8e18-437c43a7b24d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014910 Aug 10 09:57:12.293541 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 10 09:57:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 09:57:13.251310 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-3dabe2de-ce30-4802-8ce1-22cd4c892721 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:13.252322 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-3dabe2de-ce30-4802-8ce1-22cd4c892721 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 10 09:57:13.252722 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:13.769501 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-34e3e639-93f3-450e-86ea-27594cb1ecfd admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:13.774713 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.wsgi [None req-34e3e639-93f3-450e-86ea-27594cb1ecfd admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-34e3e639-93f3-450e-86ea-27594cb1ecfd admin admin] Request method failure captured: Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Accept: application/json Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Accept-Encoding: gzip, deflate Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Connection: keep-alive Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Content-Length: 0 Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Host: 10.222.0.20 Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Openstack-Api-Version: compute 2.90 Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Openstack-System-Scope: None Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: User-Agent: python-novaclient Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Auth-Token: gAAAAABi84D5EUj3p5Ld2atpK1LZmnuylIx7-9W2VzzZyUMELVDZl6fb2jbxXHvHV8ieHKYjweh-lWLEb-RaEfEPP4NVuyAiv3ItuRH04HDhN4M-9DKN2zEESVa5TizYoOUixRxtzr1Hyo3OvW1kp7eeVyKyKYJcOoy2SAbe73HZ2yP97qZKG1g Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Domain-Id: None Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Domain-Name: None Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Identity-Status: Confirmed Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Is-Admin-Project: True Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Domain-Id: default Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Domain-Name: Default Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Name: admin Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Role: admin,reader,member Aug 10 09:57:13.776242 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Roles: admin,reader,member Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}] Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant: admin Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant-Name: admin Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User: admin Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Domain-Id: default Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Domain-Name: Default Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Id: 2ff7daf364734feb8aab110b9b2ef63b Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Name: admin Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: method: > Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: exception: Flavor 84 could not be found. Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: action_args: {'id': '84'} Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 09:57:13.777877 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:13.778804 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.780119 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-34e3e639-93f3-450e-86ea-27594cb1ecfd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 09:57:13.781901 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-34e3e639-93f3-450e-86ea-27594cb1ecfd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387215 Aug 10 09:57:13.781901 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 10 09:57:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:13.787680 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-3082dd34-f89a-4201-b793-aeff7eb8c376 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:13.802268 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-3082dd34-f89a-4201-b793-aeff7eb8c376 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018185 Aug 10 09:57:13.802775 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 10 09:57:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 09:57:13.811731 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d5b5ec47-f891-408c-99f9-bf56bd35c333 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:13.828198 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d5b5ec47-f891-408c-99f9-bf56bd35c333 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019958 Aug 10 09:57:13.828718 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 10 09:57:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 09:57:13.838068 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6929625e-4e6e-484a-a217-85a598989ceb admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:13.843916 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.wsgi [None req-6929625e-4e6e-484a-a217-85a598989ceb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6929625e-4e6e-484a-a217-85a598989ceb admin admin] Request method failure captured: Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Accept: application/json Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Accept-Encoding: gzip, deflate Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Connection: keep-alive Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Content-Length: 0 Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Host: 10.222.0.20 Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Openstack-Api-Version: compute 2.90 Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Openstack-System-Scope: None Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: User-Agent: python-novaclient Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Auth-Token: gAAAAABi84D5EUj3p5Ld2atpK1LZmnuylIx7-9W2VzzZyUMELVDZl6fb2jbxXHvHV8ieHKYjweh-lWLEb-RaEfEPP4NVuyAiv3ItuRH04HDhN4M-9DKN2zEESVa5TizYoOUixRxtzr1Hyo3OvW1kp7eeVyKyKYJcOoy2SAbe73HZ2yP97qZKG1g Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Domain-Id: None Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Domain-Name: None Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Identity-Status: Confirmed Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Is-Admin-Project: True Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Domain-Id: default Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Domain-Name: Default Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Name: admin Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Role: admin,reader,member Aug 10 09:57:13.845417 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Roles: admin,reader,member Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}] Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant: admin Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant-Name: admin Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User: admin Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Domain-Id: default Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Domain-Name: Default Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Id: 2ff7daf364734feb8aab110b9b2ef63b Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Name: admin Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: method: > Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: exception: Flavor 84 could not be found. Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: action_args: {'id': '84'} Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 09:57:13.846907 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:13.847839 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:13.849082 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6929625e-4e6e-484a-a217-85a598989ceb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 09:57:13.850455 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-6929625e-4e6e-484a-a217-85a598989ceb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012480 Aug 10 09:57:13.850455 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 10 09:57:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:14.807611 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-d5b5ec47-f891-408c-99f9-bf56bd35c333 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:14.808593 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-d5b5ec47-f891-408c-99f9-bf56bd35c333 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 10 09:57:14.808980 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:15.320868 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6b7d68ef-ab31-4690-9aef-7ca5fba9edc3 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:15.326830 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.wsgi [None req-6b7d68ef-ab31-4690-9aef-7ca5fba9edc3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6b7d68ef-ab31-4690-9aef-7ca5fba9edc3 admin admin] Request method failure captured: Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Accept: application/json Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Accept-Encoding: gzip, deflate Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Connection: keep-alive Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Content-Length: 0 Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Host: 10.222.0.20 Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Openstack-Api-Version: compute 2.90 Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Openstack-System-Scope: None Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: User-Agent: python-novaclient Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Auth-Token: gAAAAABi84D6BI_xv7LYYj5QxrXgXobfl-O9B1CaCpD1fw7e9ag7dctz5SfGBWZfzbJwjgHGwl5DJ0XfIHCn2rl4n2XXcjhwYUanFi3i5UTWOpWMuy_pQLRZwiMBz_Gk07hk61FPokZNVi7HSQdBQgvDnHIbIp6lNzYyOlHccz-fWt619b5kySA Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Domain-Id: None Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Domain-Name: None Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Identity-Status: Confirmed Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Is-Admin-Project: True Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Domain-Id: default Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Domain-Name: Default Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Project-Name: admin Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Role: admin,reader,member Aug 10 09:57:15.329105 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Roles: admin,reader,member Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}] Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant: admin Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-Tenant-Name: admin Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User: admin Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Domain-Id: default Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Domain-Name: Default Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Id: 2ff7daf364734feb8aab110b9b2ef63b Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: X-User-Name: admin Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: method: > Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: exception: Flavor 451 could not be found. Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: action_args: {'id': '451'} Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 09:57:15.330685 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:15.331697 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.332987 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-6b7d68ef-ab31-4690-9aef-7ca5fba9edc3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 09:57:15.334252 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-6b7d68ef-ab31-4690-9aef-7ca5fba9edc3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386459 Aug 10 09:57:15.334252 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 10 09:57:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:15.340513 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-654a7c76-73cd-47e5-809f-d94d2256fdb3 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:15.355908 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-654a7c76-73cd-47e5-809f-d94d2256fdb3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018979 Aug 10 09:57:15.356431 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 10 09:57:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 09:57:15.365866 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:15.380783 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018560 Aug 10 09:57:15.381306 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 10 09:57:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 09:57:15.390875 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-91b91733-42cd-431b-a570-ec1c8b02b769 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:15.396244 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.wsgi [None req-91b91733-42cd-431b-a570-ec1c8b02b769 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-91b91733-42cd-431b-a570-ec1c8b02b769 admin admin] Request method failure captured: Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Accept: application/json Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Accept-Encoding: gzip, deflate Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Connection: keep-alive Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Content-Length: 0 Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Host: 10.222.0.20 Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Openstack-Api-Version: compute 2.90 Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Openstack-System-Scope: None Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: User-Agent: python-novaclient Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Auth-Token: gAAAAABi84D6BI_xv7LYYj5QxrXgXobfl-O9B1CaCpD1fw7e9ag7dctz5SfGBWZfzbJwjgHGwl5DJ0XfIHCn2rl4n2XXcjhwYUanFi3i5UTWOpWMuy_pQLRZwiMBz_Gk07hk61FPokZNVi7HSQdBQgvDnHIbIp6lNzYyOlHccz-fWt619b5kySA Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Domain-Id: None Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Domain-Name: None Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Identity-Status: Confirmed Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Is-Admin-Project: True Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Domain-Id: default Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Domain-Name: Default Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Project-Name: admin Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Role: admin,reader,member Aug 10 09:57:15.397735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Roles: admin,reader,member Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9cee49555c8143ed868a4be75b65ed07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9cee49555c8143ed868a4be75b65ed07"}]}] Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant: admin Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant-Id: 9cee49555c8143ed868a4be75b65ed07 Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-Tenant-Name: admin Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User: admin Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Domain-Id: default Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Domain-Name: Default Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Id: 2ff7daf364734feb8aab110b9b2ef63b Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: X-User-Name: admin Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: method: > Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: exception: Flavor 451 could not be found. Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: action_args: {'id': '451'} Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 09:57:15.399257 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:15.400233 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: ERROR nova.api.openstack.wsgi Aug 10 09:57:15.401373 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-91b91733-42cd-431b-a570-ec1c8b02b769 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103244) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 09:57:15.402391 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-91b91733-42cd-431b-a570-ec1c8b02b769 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012199 Aug 10 09:57:15.402391 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 10 09:57:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:16.347495 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:16.348493 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 10 09:57:16.348887 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:16.975525 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-0f6787d4-a50d-433f-a64e-9b66742defd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:57:16.994419 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-0f6787d4-a50d-433f-a64e-9b66742defd1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.510342 Aug 10 09:57:16.994975 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 10 09:57:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:57:17.959407 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:17.960450 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 10 09:57:17.960850 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:18.471063 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-9ebb9ad9-a057-4ca1-832c-93cea59924db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:57:18.488932 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-9ebb9ad9-a057-4ca1-832c-93cea59924db admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.391388 Aug 10 09:57:18.489468 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 10 09:57:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 09:57:19.446284 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:19.447308 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 10 09:57:19.447705 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:19.956245 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-9fbc2799-bc0c-4af5-b69f-3db2e7e7cc3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:57:19.974101 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-9fbc2799-bc0c-4af5-b69f-3db2e7e7cc3d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.390839 Aug 10 09:57:19.974636 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 10 09:57:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:57:20.922455 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:20.923500 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 10 09:57:20.923898 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:21.437824 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-adcc9a76-2323-4b61-98b6-3ad2a06bf223 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 09:57:21.456407 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-adcc9a76-2323-4b61-98b6-3ad2a06bf223 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.395774 Aug 10 09:57:21.456949 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 10 09:57:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 09:57:22.417136 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:22.418166 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 10 09:57:22.418561 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 09:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:57:22.920900 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-191192dc-cb58-4f03-b6c3-225b215e032f admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:57:22.941330 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-191192dc-cb58-4f03-b6c3-225b215e032f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.387544 Aug 10 09:57:22.941858 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Aug 10 09:57:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 09:58:13.566818 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:58:13.567884 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-e0b1e61f-b37a-4ebb-9b47-41c980911596 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 10 09:58:13.568284 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 931 bytes} [Wed Aug 10 09:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 09:58:13.578868 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:13.948772 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-9f2e9235-302e-43bd-b760-023f7b9abe38 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:58:13.969330 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-9f2e9235-302e-43bd-b760-023f7b9abe38 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395129 Aug 10 09:58:13.969861 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1292 bytes} [Wed Aug 10 09:58:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 09:58:13.993622 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-febcb740-0a72-4d92-b9fb-8059867589c1 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:58:13.996979 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG dbcounter [-] [103243] Writing DB stats nova_api:SELECT=14 {{(pid=103243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:14.003229 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-febcb740-0a72-4d92-b9fb-8059867589c1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013296 Aug 10 09:58:14.003749 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Aug 10 09:58:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 09:58:14.015153 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-531c3e6a-7e80-48b3-aa4b-0c83d8d2a024 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:58:14.022535 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-531c3e6a-7e80-48b3-aa4b-0c83d8d2a024 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010946 Aug 10 09:58:14.023075 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Aug 10 09:58:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 09:58:14.034484 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:58:14.041796 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011349 Aug 10 09:58:14.042295 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1286 bytes} [Wed Aug 10 09:58:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 09:58:14.053686 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-4a071bb9-abe5-40d4-8fda-7be276e0ee36 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 09:58:14.060975 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-4a071bb9-abe5-40d4-8fda-7be276e0ee36 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010611 Aug 10 09:58:14.061477 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1283 bytes} [Wed Aug 10 09:58:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:01:05.896276 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:05.897277 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 10 10:01:05.897664 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 10:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:01:06.038282 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=6 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:06.194190 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:06.196585 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:01:06.196585 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Aug 10 10:01:06.197697 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:06.198167 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:06.198615 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:06.199354 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:06.199803 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:06.200215 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:06.233944 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-5f3cc307-63bd-4ee7-9817-86b7b133d553 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197210 Aug 10 10:01:06.234494 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 10 10:01:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:01:07.063498 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:07.064488 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 10 10:01:07.064877 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 10:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:01:07.253225 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:07.255613 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:01:07.255613 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Aug 10 10:01:07.256732 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:07.257196 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:07.257613 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:07.258309 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:07.258744 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:07.259181 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:07.277947 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-1be421a6-0f53-4416-b4cc-49099b631940 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075770 Aug 10 10:01:07.278474 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 10 10:01:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 10:01:18.514560 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:18.515621 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 10 10:01:18.516014 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 10:01:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:01:18.658592 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell0:SELECT=4 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:18.659308 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_cell1:SELECT=4 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:18.659909 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG dbcounter [-] [103244] Writing DB stats nova_api:SELECT=8 {{(pid=103244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:18.707755 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:18.710150 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:01:18.710150 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Aug 10 10:01:18.711270 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:18.711735 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:18.712157 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:18.712855 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:18.713294 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:18.713701 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:18.738560 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-5794228e-3b03-4af9-a899-af1633c33d96 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084903 Aug 10 10:01:18.739307 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 10 10:01:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:01:19.609283 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: DEBUG nova.api.openstack.wsgi [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] Calling method '>' {{(pid=103243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:19.610285 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: INFO nova.api.openstack.requestlog [None req-f32810e3-db99-495f-a0ef-aaaad308a8d3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 10 10:01:19.610679 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: [pid: 103243|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 10 10:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:01:19.797790 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG nova.api.openstack.wsgi [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] Calling method '>' {{(pid=103244) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:01:19.800174 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:01:19.800174 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: warnings.warn(msg) Aug 10 10:01:19.801273 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:19.801747 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:19.802171 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:19.802915 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:01:19.803397 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:01:19.803813 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: DEBUG oslo_concurrency.lockutils [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103244) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:01:19.825475 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: INFO nova.api.openstack.requestlog [None req-6fb4c59d-8f0b-4331-87a3-fd8795b28ebd admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078265 Aug 10 10:01:19.826015 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: [pid: 103244|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 10 10:01:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:02:15.177693 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: Wed Aug 10 10:02:15 2022 - graceful shutdown triggered... Aug 10 10:02:15.177824 dv-cinder-850836-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 10:02:15.178707 dv-cinder-850836-5-iscsi devstack@n-api.service[103243]: Gracefully killing worker 1 (pid: 103243)... Aug 10 10:02:15.179176 dv-cinder-850836-5-iscsi devstack@n-api.service[103244]: Gracefully killing worker 2 (pid: 103244)... Aug 10 10:02:16.179068 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: worker 1 buried after 1 seconds Aug 10 10:02:16.179608 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: worker 2 buried after 1 seconds Aug 10 10:02:16.179608 dv-cinder-850836-5-iscsi devstack@n-api.service[103242]: goodbye to uWSGI. Aug 10 10:02:16.180644 dv-cinder-850836-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 10:02:16.181188 dv-cinder-850836-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 10:02:16.184075 dv-cinder-850836-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 10:02:16.193815 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 10:02:16.195858 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 10:02:16 2022] *** Aug 10 10:02:16.196047 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 10:02:16.196184 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 10:02:16.196299 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: nodename: dv-cinder-850836-5-iscsi Aug 10 10:02:16.196407 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: machine: x86_64 Aug 10 10:02:16.196515 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: clock source: unix Aug 10 10:02:16.196629 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: pcre jit disabled Aug 10 10:02:16.196821 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: detected number of CPU cores: 4 Aug 10 10:02:16.196976 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: current working directory: / Aug 10 10:02:16.197123 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: detected binary path: /usr/bin/uwsgi-core Aug 10 10:02:16.197282 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: your processes number limit is 47680 Aug 10 10:02:16.197426 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: your memory page size is 4096 bytes Aug 10 10:02:16.197569 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: detected max file descriptor number: 2048 Aug 10 10:02:16.197712 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: lock engine: pthread robust mutexes Aug 10 10:02:16.198029 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: thunder lock: enabled Aug 10 10:02:16.198372 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 10:02:16.198498 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 10:02:16.239530 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: Python main interpreter initialized at 0x56373d8139c0 Aug 10 10:02:16.239530 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: python threads support enabled Aug 10 10:02:16.239530 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: your server socket listen backlog is limited to 100 connections Aug 10 10:02:16.239530 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: your mercy for graceful operations on workers is 90 seconds Aug 10 10:02:16.240000 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 10:02:16.240000 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: *** Operational MODE: preforking *** Aug 10 10:02:16.240291 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: *** uWSGI is running in multiple interpreter mode *** Aug 10 10:02:16.240291 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: spawned uWSGI master process (pid: 117875) Aug 10 10:02:16.240437 dv-cinder-850836-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 10:02:16.241839 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: spawned uWSGI worker 1 (pid: 117895, cores: 1) Aug 10 10:02:16.241839 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: spawned uWSGI worker 2 (pid: 117896, cores: 1) Aug 10 10:02:16.241839 dv-cinder-850836-5-iscsi devstack@n-api.service[117875]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 10:02:16.906263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 10:02:16.907423 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 10:02:18.060896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:02:18.060896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: from cryptography.utils import int_from_bytes Aug 10 10:02:18.061531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:02:18.061531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: from cryptography.utils import int_from_bytes Aug 10 10:02:18.061668 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:02:18.061668 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: from cryptography.utils import int_from_bytes Aug 10 10:02:18.061668 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 10:02:18.061668 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: from cryptography.utils import int_from_bytes Aug 10 10:02:20.372649 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 10:02:20.373351 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 10:02:20.373443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 10:02:20.373797 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 10:02:20.374071 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 10:02:20.374447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.375380 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.375710 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.376035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.376153 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 10:02:20.376500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 10:02:20.376570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.376681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.376889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 10:02:20.376997 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.377196 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 10:02:20.377305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.377464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 10:02:20.377620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.377840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.377996 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.378163 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.378263 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.378494 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-5-iscsi {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.378603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.378812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.378933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.379125 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.379212 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.379446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.379567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.379767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.379866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.380076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.380187 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.380402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.380503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.380654 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.380752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.380976 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.381190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.382630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850836-5-iscsi {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.382630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.383126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.383339 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.383559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.383786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.384018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.384247 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.384463 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.384705 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.384940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.385156 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.385374 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.385589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.385796 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.385796 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.386205 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.386447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.386652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.386871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.387106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.387106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.387545 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-5-iscsi {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.387545 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.387928 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.388076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.388256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.388412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.388599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.388599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.388899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.389041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.389191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.389362 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.389534 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.389681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.389877 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.390032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850836-5-iscsi {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.390234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.390394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.390559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.390752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.390927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.391109 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.392590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.392590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.392887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.393032 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.393188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.393369 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.393556 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.393708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.393850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.394037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.394214 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.394368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.394517 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.394667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.394809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.394988 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.395171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.395316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.395457 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.395605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.396150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.396310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.396463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.396629 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.396785 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.396934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.397083 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.397234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.397385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.397528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.397671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.397813 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.397964 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.398107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.398268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.398410 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.398559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.398700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.398851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.399022 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.399178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.399330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.399472 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.399617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.401242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.401242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.401659 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.401857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402022 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.402508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.403735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.403735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.403735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.403735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.403735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.405856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.406119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.406400 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.406551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.406702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.406853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.407026 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.407188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.407516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.407680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.407825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.407974 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.408126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.408277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.408434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.408577 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.408725 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.408874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.409028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.409179 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.409348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.409498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.409640 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.409781 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.410001 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.410161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.410317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.410472 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.410472 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.410748 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.410897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.411167 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.411332 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.411646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.411799 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.411951 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.412101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.413170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.414244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.414244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415229 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415483 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415859 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.415935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416177 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416269 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416355 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416535 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416800 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416800 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.416946 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417118 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417470 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417552 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417897 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417989 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.417989 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418152 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418333 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418423 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418512 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418684 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.418968 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419133 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419133 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419709 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.419885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.423010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.423205 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.423358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.423505 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.423666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.423822 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.423975 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.424119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.424270 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.424422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.424574 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.424823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.425049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.425220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.425371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.425531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.425680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.425823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.425964 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.426265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.426572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.427910 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.428063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.428221 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.428372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.428372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.428372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.428372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.428372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.428372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.429174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.429174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.429823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.429988 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.430174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.430331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.430331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.430331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.430744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.430744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.431109 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.431434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.431769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.431991 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.432148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.432326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.432486 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.432639 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.432857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.433002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.433151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.433329 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.433484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.433636 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.433787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.433940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.434083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.434231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.434381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.434539 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.434688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 10:02:20.434923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.435271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.435429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.435583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.435746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.435890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.436039 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.436193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.436336 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.436478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.436632 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.436774 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.436916 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.437865 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.438020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.438173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.438324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.438324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.438609 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.438771 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.438915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.439173 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.439319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.439698 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.439994 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.440187 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.440347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.440504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.440648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.440791 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.440932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.441073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.441229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.441385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.441538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.441689 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.441833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.442020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.442280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.442440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.442584 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.442734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.442885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.443087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.443247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.443403 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.443545 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.443694 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.443836 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.443986 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.444138 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.444289 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.444432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.444581 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.444734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.444959 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.445131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.445373 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.445521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.445664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.445813 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.445965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.446118 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.446261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.446409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.446559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.446702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.446858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.446858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.447164 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.447418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.447569 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.447721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.447982 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.447982 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.448264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.448264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.448540 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.448540 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.448824 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.448974 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.449154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.449305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.449464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.449464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.450105 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.450306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.450456 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.450599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.450749 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.450905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.451073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.451216 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.451370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.451513 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.451664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.451828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.451980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.452123 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.452271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.452421 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.452570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.452763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.452910 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.453061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.453204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.453362 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.453362 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.453676 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.453832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.453988 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.454137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.454292 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.454455 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.454611 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.454767 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.454916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.455181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.455363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.455601 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.455756 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.455923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.456073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.456220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.456375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.456375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.456675 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.456831 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.456979 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.457135 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.457297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.457464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.457700 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.457854 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.458031 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.458271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.458436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.458595 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.458744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.458899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.459071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.459071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.459367 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.459367 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.459675 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.460158 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.460365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.460532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.460698 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.460847 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.460995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.461142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.461296 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.461296 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.461595 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.461744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.461899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.461899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.462181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.462347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.462507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.462663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.462812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.462987 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.463143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.463143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.463462 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.464201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.464371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.464522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.464677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.464903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.465082 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.465325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.465490 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.465733 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.465890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.466050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.466199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.466354 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.466510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.466658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.466815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.466986 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.467142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.467316 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.467466 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.467613 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.467876 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.468035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.468184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.468946 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.469106 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.469265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.469418 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.469418 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.470862 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.471666 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.471838 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.471992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.472151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.472309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.472464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.472628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.472778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.472934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.473090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.473246 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.473395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.473562 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.473732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.473959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.474125 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.474125 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.474429 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.474585 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.474742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.474891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.475139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.475322 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.475567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.475567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.475957 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.476130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.476287 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.476453 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.476612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.476762 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.476910 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.477065 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.477214 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.477362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.477524 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.477673 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.477821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.478103 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.478272 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.478435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.478593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.478742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.478899 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.479184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.479337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.479499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.479650 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.479797 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.479945 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.480546 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.480732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.480902 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.481261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.481424 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.481580 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.481731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.481879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.482037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.482193 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.482340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.482522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.482656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.482783 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.482907 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483166 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483293 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483386 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483568 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.483917 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.484538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.484639 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.484730 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.484815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.484897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.484979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485070 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485154 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485235 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485397 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485477 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485587 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485682 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485766 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.485848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486291 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486383 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486466 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486549 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486637 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.486907 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487439 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487675 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.487941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488021 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488223 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488397 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488501 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488583 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488773 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.488858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489574 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489658 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.489859 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490004 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490098 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490182 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490824 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.490909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491018 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491018 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491547 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491631 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491631 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491804 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491888 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.491970 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492058 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492236 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492410 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492652 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492747 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492845 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.492935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493285 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493790 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.493963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.494109 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.494233 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.494430 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.494562 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.494745 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.494905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.495081 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.495234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.495407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.495540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.495718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.495865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.496133 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.496290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.496389 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.496482 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.496636 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.496761 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.496946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.497069 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.497266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.497403 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.497667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.497840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.497976 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.498186 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.498320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.498498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.498632 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.498821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.498923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.499154 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.499259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.499481 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.499608 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.499818 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.500177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.500402 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.500509 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.500811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.500900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.501013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.501186 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.501317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.501417 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.501628 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.501731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.501933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.502032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.502235 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.502327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.502548 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.502655 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.502849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.502940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.503179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.503273 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.503501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.503593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.503786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.503892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.504088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.504186 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.504394 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.504486 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.504701 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.504796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.505018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.505175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.505323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.505749 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.506067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.506314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.506472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.506629 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.506798 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.507094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.507253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.507414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.507572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.507729 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.507889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.508052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.508207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.508365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.508521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.508680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.508830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.508988 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.509144 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.509293 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.509442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.509710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.509875 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.510044 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.510194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.510342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.510498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.510876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.511074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.511235 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.511393 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.511544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.511702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.511852 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512001 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512318 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512422 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512518 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512609 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512789 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.512963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513057 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513737 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.513934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.514078 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.514252 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.514372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.514563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.514734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.514868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.515104 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.515245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.515440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.515548 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.515810 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.515913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.516131 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.516231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.516472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.516580 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.516733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.516901 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.517071 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.517342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.517442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.517647 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.517806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.517950 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.518134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.518258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.518449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.518554 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.518768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.518869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.519100 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.519207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.519413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.519507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.519743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.519869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.520063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.520170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.520368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.520462 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.520674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.520782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.521031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.521125 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.521278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.521371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.521601 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.521694 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.521913 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.522007 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.522220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.522356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.522530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.522624 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.522834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.522935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.523172 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.523279 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.523477 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.523570 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.523786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.523892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.524089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.524183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.524393 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.524500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.524698 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.524801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.525005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.525097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.525310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.525410 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.525619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.525721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.525928 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.526027 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.526233 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.526325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.526540 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.526652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.526842 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.526935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.527176 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.527277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.527487 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.527581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.527804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.527900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.528111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.528203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.528442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.528541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.528762 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.528856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.529074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.529173 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.529386 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.529480 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.529699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.529792 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.530003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.530182 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.530320 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.530412 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.530633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.530724 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.531470 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.531570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.531773 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.531912 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.532080 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.532180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.532404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.532553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.532724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.532843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.533040 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.533141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.533356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.533457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.533669 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.533770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.533993 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.534093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.534297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.534389 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.534603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.534694 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.534908 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.535020 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.535252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.535354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.535558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.535651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.535867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.535965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.536188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.536282 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.536504 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.536611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.536823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.536935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.537139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.537297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.537454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.537610 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.537764 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.537926 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.538079 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.538251 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.538391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.538578 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.538700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.538906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.539068 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.539284 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.539386 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.539604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.539696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.539948 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.540075 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.540253 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.540359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.540574 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.540668 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.540871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.541310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.541713 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.542040 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.542357 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.542687 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.543035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.543259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.543381 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.543650 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.543770 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.544032 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.544186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.544356 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.544528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.544710 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.544849 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.545066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.545194 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.545412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.545530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.545743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.545861 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.547594 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.547723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.547854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.547968 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.547968 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.548357 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.548357 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.548607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.548719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.548830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.548952 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549070 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549396 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549534 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.549995 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550240 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550361 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550591 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.550939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.551116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.551364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.551531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.551689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.551867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.552178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.552276 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.552503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.552817 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.552921 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.553133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.553305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.553431 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.553643 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.553735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.554088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.554193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.554379 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.554487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.554702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.554793 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.555089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.555252 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.555421 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.555518 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.555734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.555823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.556071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.556177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.556400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.556491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.556719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.556817 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.557043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.557136 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.557359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.557455 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.557663 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.557760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.557969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.558068 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.558281 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.558377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.558587 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.558685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.558892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.559096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.559250 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.559435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.559554 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.559761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.559864 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.560100 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.560199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.560438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.560528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.560756 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.560859 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.561059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.561148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.561385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.561476 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.561696 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.561830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.562006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.562117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.562338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.562436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.562645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.562920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.563079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.563306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.563431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.563638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.563745 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.563950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.564040 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.564274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.564364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.564594 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.564692 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.564911 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.565001 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.565228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.565326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.565547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.565646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.565867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.565959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.566186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.566284 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.566501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.566593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.566813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.566904 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.567158 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.567264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.567476 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.567568 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.567795 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.567895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.568137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.568356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.568447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.568689 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.568780 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.569004 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.569100 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.569320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.569411 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.569631 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.569729 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.569947 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.570067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.570262 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.570390 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.570573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.570737 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.570892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.571102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.571213 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.571433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.571523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.571764 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.571891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.572102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.572206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.572443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.572539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.572782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.572891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.573098 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.573315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.573434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.573637 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.573736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.573959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.574071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.574311 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.574412 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.574620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.574716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.574937 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.575054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.575277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.575371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.575592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.575724 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.575904 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.576031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.576218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.576358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.576532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.576672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.576846 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.576988 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.577229 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.577398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.577591 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.577798 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.577959 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.578128 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.578319 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.578478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.578677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.578841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.579046 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.579370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.579706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.580035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.580365 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.580696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.581000 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.581173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.581342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.581491 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.581648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.581796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.581967 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.582121 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.582335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.582496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.582652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.582800 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.583145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.583323 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.583577 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.583743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.583901 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.584061 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.584216 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.584365 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.584597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.584750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.584859 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.584985 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.585144 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.585316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.585547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.585656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.585865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.585966 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.586225 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.586315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.586561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.586724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.586882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.587145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.587281 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.587423 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.587571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.587719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.587869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.588008 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.588202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.588338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.588552 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.588688 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.588879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.589018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.589200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.589507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.589653 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.589839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.590017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.590208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.590348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.590534 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.590852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.591139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.591245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.591440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.591630 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.591734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.591965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.592056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.592290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.592381 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.592658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.592761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.592973 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.593071 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.593933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.594054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.594260 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.594375 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.594583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.594990 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.595170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.595340 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.595502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.595660 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.595809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.595971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.596127 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.596277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.596435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.596585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.596741 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.596897 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.597054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.597214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.597371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.597660 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.597816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.597973 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.598122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.598315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.598485 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.598643 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.598799 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.598998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.599171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.599333 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.599502 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.599651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.599800 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.599955 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.600104 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.600267 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.600424 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.600581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.600730 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.600877 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.601031 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.601189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.601346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.601506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.601691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.601843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.601999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.602157 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.602315 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.602471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.602626 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.602776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.602934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.603122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.603362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.603529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.603695 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.603853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.604118 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.604283 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.604435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.604592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.604742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.605099 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.605267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.605427 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.605576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.605733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.605901 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.606052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.606052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.606364 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.606521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.606678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.606827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.607032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.607191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.607341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.607490 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.607639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.607798 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.607968 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.608119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.608276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.608426 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.608575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.608723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.608880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.609585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.609750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.609900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.610049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.610212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.610374 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.610531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.610688 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.610845 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.611024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.611190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.611341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.611491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.611647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.611797 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.611954 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.612117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.612267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.612425 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.612582 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.612733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.612881 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.613042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.613192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.613367 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.613528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.613687 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.613851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.614008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.614259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.614423 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.614587 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.614743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.614903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.615307 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.615501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.615655 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.615812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.615962 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.616124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.616285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.617022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.617188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.617363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.617523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.617684 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.617833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.617983 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.618131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.618278 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.618435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.618586 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.618737 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.618900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.619076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.619238 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.619479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.619638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.619796 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.619953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.619953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.620238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.620402 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.620560 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.620717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.620867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.621016 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.621179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.621347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.621505 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.621655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.621811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.621961 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.622124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.622282 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.622439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.622589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.622746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.622897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.623107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.623269 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.623429 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.623586 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.623736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.623898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.624048 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.624209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.624466 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.624657 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.624810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.625436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.625630 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.625782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.625951 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.626103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.626262 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.626434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.626592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.626749 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.626907 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627070 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627486 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.627945 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628249 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628576 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628657 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628753 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.628933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629105 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629185 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629369 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629458 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629789 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.629959 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630047 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630296 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630377 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630682 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.630844 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.631048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.631195 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.631387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.631526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.631707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.631859 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.632032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.632182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.632345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.632514 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.632668 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.632849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.632982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.633171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.633305 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.633502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.633627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.633822 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.633947 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.634160 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.634259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.634512 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.634604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.634851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.634942 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.635205 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.635323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.635521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.635611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.635832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.635923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.636143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.636231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.636500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.636674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.636770 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.636855 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.637088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.637192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.637440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.637551 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.637721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.637815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.638040 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.638131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.638353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.638501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.638667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.638764 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.638999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.639105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.639317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.639416 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.639636 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.639948 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.640040 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.640283 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.640386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.640598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.640689 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.640911 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.641009 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.641224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.641324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.641537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.641627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.641849 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.641938 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.642160 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.642250 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.642474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.642579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.642788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.642886 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.643128 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.643247 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.643445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.643537 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.643756 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.643846 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.644085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.644177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.644414 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.644512 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.644746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.644842 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.645068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.645166 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.645397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.645525 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.645723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.645830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.646040 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.646129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.646356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.646445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.646673 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.646776 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.647009 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.647103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 10:02:20.647354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.647672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.647995 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.648320 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.648642 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.649171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.649702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.650048 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.650394 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.650714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.651082 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.651410 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.651746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.655165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.657132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.657132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.657132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.657132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.657132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.657132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.657132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.658123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.658123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.658123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.658567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.658716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.659059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.659611 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.660146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.660478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.660799 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 10:02:20.661056 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 10:02:20.800985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO dbcounter [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Registered counter for database nova_api Aug 10 10:02:20.822896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_db.sqlalchemy.engines [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:20.827510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Registered counter for database nova_api Aug 10 10:02:20.831871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writer thread running {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:20.848589 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:20.856598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:20.889503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.context [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e525c749-c7e5-42c0-b469-97038053e8e5(cell1) {{(pid=117895) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 10:02:20.894077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:02:20.894557 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:02:20.896168 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:02:20.896902 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:02:20.897349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:02:20.899898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:02:20.901918 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO dbcounter [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Registered counter for database nova_cell0 Aug 10 10:02:20.906477 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO dbcounter [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Registered counter for database nova_cell1 Aug 10 10:02:20.913593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_db.sqlalchemy.engines [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:20.915457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.context [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e525c749-c7e5-42c0-b469-97038053e8e5(cell1) {{(pid=117896) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 10:02:20.916747 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_db.sqlalchemy.engines [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:20.919220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writer thread running {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:20.919591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:02:20.920084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:02:20.921694 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:02:20.922437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:02:20.922891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:02:20.925510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:02:20.927652 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Registered counter for database nova_cell0 Aug 10 10:02:20.931743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Registered counter for database nova_cell1 Aug 10 10:02:20.938874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:20.941055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:20.945659 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:21.059865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writer thread running {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:21.068516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO dbcounter [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Registered counter for database nova_cell0 Aug 10 10:02:21.075029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_db.sqlalchemy.engines [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:21.079956 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writer thread running {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:21.086210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:21.096900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO dbcounter [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Registered counter for database nova_cell0 Aug 10 10:02:21.103636 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_db.sqlalchemy.engines [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 10:02:21.108063 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writer thread running {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 10:02:21.395186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: WARNING keystonemiddleware.auth_token [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 10:02:21.403211 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: WARNING keystonemiddleware.auth_token [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 10:02:21.426864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 10:02:21.434193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 10:02:21.746378 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: WARNING keystonemiddleware.auth_token [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 10:02:21.753320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: WARNING keystonemiddleware.auth_token [None req-5244b950-b429-443b-b21a-3a5c229632f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 10:02:21.759829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56373d8139c0 pid: 117895 (default app) Aug 10 10:02:21.780157 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 10:02:21.786314 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: WARNING keystonemiddleware.auth_token [None req-7f588aa7-0117-4c30-bd3a-f7096c8edf9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 10:02:21.792954 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56373d8139c0 pid: 117896 (default app) Aug 10 10:02:56.525220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=3 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:02:56.527835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=3 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:02:56.529056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=3 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:02:56.531059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=3 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:02:58.115867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a580cb1d-35c3-4525-82db-8a96533582a7 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Action: 'create', calling method: .version_select at 0x7f2309f3edc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-45281827", "metadata": {"Type": "work"}}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a580cb1d-35c3-4525-82db-8a96533582a7 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Request method failure captured: Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 120 Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JQd_EQk5SuTBICdzPLHn336sgbtjR-i_g6dK41gWQCnYw1A8vve_-qO-ye7Wb8rXU2qcBSBUoyGOdepLpS5ceyJeT6n4_l6DuX5i6fQv2gciTa7qijC4uUk01sZVS7bDjlF5E5xRVFkB4xzlRAR8bpYyNeeyl-luxTqVTpLS-CmcI Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:02:58.133307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}] Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 1e81eef05a4a40cbaab2a3b975f8d583 Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-45281827", "metadata": {"Type": "work"}}} Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: Aug 10 10:02:58.134804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-45281827', 'metadata': {'Type': 'work'}}}} Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise error Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:02:58.135755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 10:02:58.141062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 10:02:58.144865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 10:02:58.144865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.144865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a580cb1d-35c3-4525-82db-8a96533582a7 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:02:58.144865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a580cb1d-35c3-4525-82db-8a96533582a7 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.622283 Aug 10 10:02:58.144865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 10 10:02:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1624 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:02:58.610621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83f0a4b7-5ca6-4a96-9cd2-8ec18f3e304f tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Action: 'create', calling method: .version_select at 0x7f230a0168b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1059839132", "metadata": {"Type": "work"}}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83f0a4b7-5ca6-4a96-9cd2-8ec18f3e304f tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Request method failure captured: Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 120 Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84JQd_EQk5SuTBICdzPLHn336sgbtjR-i_g6dK41gWQCnYw1A8vve_-qO-ye7Wb8rXU2qcBSBUoyGOdepLpS5ceyJeT6n4_l6DuX5i6fQv2gciTa7qijC4uUk01sZVS7bDjlF5E5xRVFkB4xzlRAR8bpYyNeeyl-luxTqVTpLS-CmcI Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:02:58.628502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}] Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 1e81eef05a4a40cbaab2a3b975f8d583 Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1059839132", "metadata": {"Type": "work"}}} Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: Aug 10 10:02:58.629743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1059839132', 'metadata': {'Type': 'work'}}}} Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise error Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi '0' Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:02:58.630495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 10:02:58.637916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 10:02:58.639708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 10:02:58.639708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.639708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83f0a4b7-5ca6-4a96-9cd2-8ec18f3e304f tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:02:58.639708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-83f0a4b7-5ca6-4a96-9cd2-8ec18f3e304f tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.487550 Aug 10 10:02:58.639708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 10 10:02:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 490 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:02:58.663500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-abfede8f-4b46-427e-a9c7-e9d3cfa72383 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Action: 'create', calling method: .version_select at 0x7f2309e4d8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1053646754", "metadata": {"Type": "work"}}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-abfede8f-4b46-427e-a9c7-e9d3cfa72383 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Request method failure captured: Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 119 Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JQd_EQk5SuTBICdzPLHn336sgbtjR-i_g6dK41gWQCnYw1A8vve_-qO-ye7Wb8rXU2qcBSBUoyGOdepLpS5ceyJeT6n4_l6DuX5i6fQv2gciTa7qijC4uUk01sZVS7bDjlF5E5xRVFkB4xzlRAR8bpYyNeeyl-luxTqVTpLS-CmcI Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:02:58.669017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}] Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 1e81eef05a4a40cbaab2a3b975f8d583 Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1053646754", "metadata": {"Type": "work"}}} Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: Aug 10 10:02:58.672253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1053646754', 'metadata': {'Type': 'work'}}}} Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise error Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi '' Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:02:58.673014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 10:02:58.674234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 10:02:58.684731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 10:02:58.684731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:02:58.684731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-abfede8f-4b46-427e-a9c7-e9d3cfa72383 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:02:58.684731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-abfede8f-4b46-427e-a9c7-e9d3cfa72383 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031797 Aug 10 10:02:58.684731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 10 10:02:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 10:02:58.688741 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fe6ff8f9-1906-4193-86fd-22d9146983bf tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Calling method '.version_select at 0x7f2309fa3f70>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:02:58.779514 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:02:58.780490 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:02:58.781220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:02:58.791685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:00.007575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-fe6ff8f9-1906-4193-86fd-22d9146983bf tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] HTTP exception thrown: Volume tempest-invalid-81563462 could not be found. Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fe6ff8f9-1906-4193-86fd-22d9146983bf tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Request method failure captured: Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-81563462 HTTP/1.1 Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84JQd_EQk5SuTBICdzPLHn336sgbtjR-i_g6dK41gWQCnYw1A8vve_-qO-ye7Wb8rXU2qcBSBUoyGOdepLpS5ceyJeT6n4_l6DuX5i6fQv2gciTa7qijC4uUk01sZVS7bDjlF5E5xRVFkB4xzlRAR8bpYyNeeyl-luxTqVTpLS-CmcI Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:03:00.012454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}] Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 1e81eef05a4a40cbaab2a3b975f8d583 Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Volume tempest-invalid-81563462 could not be found. Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'tempest-invalid-81563462'} Aug 10 10:03:00.014035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-81563462 could not be found. (HTTP 404) (Request-ID: req-45a38c45-25eb-461c-ae56-b205f8bd6c0b) Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.015559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 10:03:00.016976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-81563462 could not be found. Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:03:00.018145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-81563462 could not be found. Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-81563462 could not be found. Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fe6ff8f9-1906-4193-86fd-22d9146983bf tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Returning 404 to user: Volume tempest-invalid-81563462 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:03:00.019379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fe6ff8f9-1906-4193-86fd-22d9146983bf tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-81563462" status: 404 len: 97 microversion: 2.1 time: 1.329690 Aug 10 10:03:00.021194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1212 bytes} [Wed Aug 10 10:02:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-81563462 => generated 97 bytes in 1338 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 10:03:00.029760 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-259828ee-f5d6-46e3-a9cf-a27a76a37235 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008909 Aug 10 10:03:00.030872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 10 10:03:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 10:03:00.041204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2f0249ad-215c-49e5-8e79-be9e6c804f71 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004228 Aug 10 10:03:00.044000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Aug 10 10:03:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 10:03:00.051774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fa70631d-d164-4761-838c-18a9acdf08ff tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Calling method '.version_select at 0x7f2309dfcb80>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:00.438865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-fa70631d-d164-4761-838c-18a9acdf08ff tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] HTTP exception thrown: Volume 0f21e476-bdf2-4c39-8dc0-2fc0e215a22f could not be found. Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fa70631d-d164-4761-838c-18a9acdf08ff tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Request method failure captured: Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/os-volumes/0f21e476-bdf2-4c39-8dc0-2fc0e215a22f HTTP/1.1 Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JQd_EQk5SuTBICdzPLHn336sgbtjR-i_g6dK41gWQCnYw1A8vve_-qO-ye7Wb8rXU2qcBSBUoyGOdepLpS5ceyJeT6n4_l6DuX5i6fQv2gciTa7qijC4uUk01sZVS7bDjlF5E5xRVFkB4xzlRAR8bpYyNeeyl-luxTqVTpLS-CmcI Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:03:00.444306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}] Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 1e81eef05a4a40cbaab2a3b975f8d583 Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Volume 0f21e476-bdf2-4c39-8dc0-2fc0e215a22f could not be found. Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '0f21e476-bdf2-4c39-8dc0-2fc0e215a22f'} Aug 10 10:03:00.445748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f21e476-bdf2-4c39-8dc0-2fc0e215a22f could not be found. (HTTP 404) (Request-ID: req-5eea7861-2db7-4008-a800-db822c07e514) Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.446729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 10:03:00.448068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f21e476-bdf2-4c39-8dc0-2fc0e215a22f could not be found. Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 10:03:00.449201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f21e476-bdf2-4c39-8dc0-2fc0e215a22f could not be found. Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f21e476-bdf2-4c39-8dc0-2fc0e215a22f could not be found. Aug 10 10:03:00.450366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.456164 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fa70631d-d164-4761-838c-18a9acdf08ff tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Returning 404 to user: Volume 0f21e476-bdf2-4c39-8dc0-2fc0e215a22f could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:03:00.457851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fa70631d-d164-4761-838c-18a9acdf08ff tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/0f21e476-bdf2-4c39-8dc0-2fc0e215a22f" status: 404 len: 109 microversion: 2.1 time: 0.409812 Aug 10 10:03:00.459744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:03:00 2022] DELETE /compute/v2.1/os-volumes/0f21e476-bdf2-4c39-8dc0-2fc0e215a22f => generated 109 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:03:00.468470 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23c4c7a5-161a-41c5-9097-aad0bbdf7646 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Calling method '.version_select at 0x7f2309d41a60>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:00.534886 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-23c4c7a5-161a-41c5-9097-aad0bbdf7646 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] HTTP exception thrown: Volume ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f could not be found. Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23c4c7a5-161a-41c5-9097-aad0bbdf7646 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Request method failure captured: Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/os-volumes/ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f HTTP/1.1 Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84JQd_EQk5SuTBICdzPLHn336sgbtjR-i_g6dK41gWQCnYw1A8vve_-qO-ye7Wb8rXU2qcBSBUoyGOdepLpS5ceyJeT6n4_l6DuX5i6fQv2gciTa7qijC4uUk01sZVS7bDjlF5E5xRVFkB4xzlRAR8bpYyNeeyl-luxTqVTpLS-CmcI Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:03:00.536914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_99a927c2d1514107b2da0d6d34b35fdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/99a927c2d1514107b2da0d6d34b35fdf"}]}] Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 99a927c2d1514107b2da0d6d34b35fdf Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesNegativeTest-1293834268 Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 1e81eef05a4a40cbaab2a3b975f8d583 Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesNegativeTest-1293834268-project Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Volume ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f could not be found. Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f'} Aug 10 10:03:00.538434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f could not be found. (HTTP 404) (Request-ID: req-a75b061f-097c-43c0-aa15-6cd6e9904101) Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.548348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:03:00.550030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f could not be found. Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 10:03:00.551535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f could not be found. Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f could not be found. Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23c4c7a5-161a-41c5-9097-aad0bbdf7646 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] Returning 404 to user: Volume ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-23c4c7a5-161a-41c5-9097-aad0bbdf7646 tempest-VolumesNegativeTest-1293834268 tempest-VolumesNegativeTest-1293834268-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f" status: 404 len: 109 microversion: 2.1 time: 0.074559 Aug 10 10:03:00.553747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:03:00 2022] GET /compute/v2.1/os-volumes/ad9c9733-c7b5-42dd-b10e-16e5f8e0bb2f => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 10:03:01.134566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a2c741ee-458c-4908-850a-9dcba5113788 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d4d790>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:01.240311 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a2c741ee-458c-4908-850a-9dcba5113788 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0017660d-157c-468b-abbd-5173992e6713" status: 200 len: 349 microversion: 2.1 time: 0.119449 Aug 10 10:03:01.241178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:03:01 2022] GET /compute/v2.1/os-volumes/0017660d-157c-468b-abbd-5173992e6713 => generated 349 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:03.535772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ea25f292-e636-4076-9d92-d115ec762d78 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d413a0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:03.715265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ea25f292-e636-4076-9d92-d115ec762d78 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/330885f3-8983-427f-9a97-605deae0fcbd" status: 200 len: 350 microversion: 2.1 time: 0.185610 Aug 10 10:03:03.716692 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:03:03 2022] GET /compute/v2.1/os-volumes/330885f3-8983-427f-9a97-605deae0fcbd => generated 350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:05.774737 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-161be9be-fcf4-4370-abc8-c92c232e681c tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d4dee0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:05.883265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-161be9be-fcf4-4370-abc8-c92c232e681c tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4eff35ef-baf9-4df3-b4c1-8d4557cdd6df" status: 200 len: 350 microversion: 2.1 time: 0.114245 Aug 10 10:03:05.883752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:03:05 2022] GET /compute/v2.1/os-volumes/4eff35ef-baf9-4df3-b4c1-8d4557cdd6df => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:05.898234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ec4dd202-ae5a-4c70-815a-4f4d2526ce8e tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d415e0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:06.158231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ec4dd202-ae5a-4c70-815a-4f4d2526ce8e tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.264077 Aug 10 10:03:06.159605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Aug 10 10:03:05 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:06.173741 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-58b17124-1b52-41e6-a345-1f4a39eead7c tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d4dd30>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:06.453378 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-58b17124-1b52-41e6-a345-1f4a39eead7c tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.281308 Aug 10 10:03:06.471028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-234cf245-3d7e-4fb4-9d9e-60ea264c309c tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d571f0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:06.471489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1149 bytes} [Wed Aug 10 10:03:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:06.759729 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-234cf245-3d7e-4fb4-9d9e-60ea264c309c tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.293784 Aug 10 10:03:06.774358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1134 bytes} [Wed Aug 10 10:03:06 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:06.775584 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-38192e8f-6a8f-4b59-9669-bc2b8ebf6a6f tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d5c940>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:06.902881 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-38192e8f-6a8f-4b59-9669-bc2b8ebf6a6f tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133190 Aug 10 10:03:06.918310 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1167 bytes} [Wed Aug 10 10:03:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:06.921182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-959a8574-4203-470d-8e6b-72cf6896dc99 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d57940>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:07.046535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-959a8574-4203-470d-8e6b-72cf6896dc99 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.131619 Aug 10 10:03:07.064708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1170 bytes} [Wed Aug 10 10:03:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:07.065110 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-406f8ed9-8533-49d5-a863-14f78e9e3279 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d5c8b0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:07.269358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-406f8ed9-8533-49d5-a863-14f78e9e3279 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.210899 Aug 10 10:03:07.270038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 9/17] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Aug 10 10:03:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:07.285188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2fd6f4a8-e0d0-45f3-8b13-991d47807a75 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d53670>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:07.545108 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2fd6f4a8-e0d0-45f3-8b13-991d47807a75 tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.265245 Aug 10 10:03:07.545958 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1188 bytes} [Wed Aug 10 10:03:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:07.559802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f0679207-49e9-4d3a-8e12-6880b91ab07b tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] Calling method '.version_select at 0x7f2309d4d940>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:07.775443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f0679207-49e9-4d3a-8e12-6880b91ab07b tempest-VolumesTestJSON-620183982 tempest-VolumesTestJSON-620183982-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.219528 Aug 10 10:03:07.776444 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 10/19] 10.222.0.20 () {58 vars in 1155 bytes} [Wed Aug 10 10:03:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:09.595033 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1096749783", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "networks": [{"uuid": "0349aa12-137f-4356-92be-ea8da338fee0"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:09.818032 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] validate_networks() for [('0349aa12-137f-4356-92be-ea8da338fee0', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:03:10.788244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-118846b7-69ea-4c31-b7a8-8c47325e0b72 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: .version_select at 0x7f2309d69c10>, body: {"keypair": {"name": "tempest-keypair-309494928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL/U2ZWwYm2d2J1QPrQXnLwYIru6KM4sBCBObP8bdCacphqtix4kzlmsn5QSQou+SEbZVbcOwAZXIhgoncoPVAMo3t+4gxp29R3E8kl6W5laL3NRRVeNTCGDzVwsdeu1w=="}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:11.046785 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-118846b7-69ea-4c31-b7a8-8c47325e0b72 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:03:11.065705 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-118846b7-69ea-4c31-b7a8-8c47325e0b72 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:03:11.193173 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-118846b7-69ea-4c31-b7a8-8c47325e0b72 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.043867 Aug 10 10:03:11.201808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:03:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:11.976073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:03:11.976645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:03:11.977029 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:03:11.977601 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:03:11.978031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:03:12.005399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:12.006153 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:12.007570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:12.008540 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:12.009147 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:12.009709 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:12.067139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Getting quotas for project 229ece368fc1458ba1c6cd94cb28f87a. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:03:12.094839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Getting quotas for user 0d53857c736c4a75abe0d4979517bc58 and project 229ece368fc1458ba1c6cd94cb28f87a. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:03:12.125780 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:03:12.132683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:03:12.306777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fbc92868-a9c4-4431-9a33-ca1f14912ffd tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.943578 Aug 10 10:03:12.307493 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 10/21] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:03:12.326489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-463dce08-8194-4e87-a17e-5995a13171f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:12.328465 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-463dce08-8194-4e87-a17e-5995a13171f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:12.778575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-463dce08-8194-4e87-a17e-5995a13171f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:12.804659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-463dce08-8194-4e87-a17e-5995a13171f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1215 microversion: 2.1 time: 0.488575 Aug 10 10:03:12.811892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 12/22] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:12 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1215 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:13.853452 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d801ac67-cd1f-4483-9207-a54247413234 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:13.854817 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d801ac67-cd1f-4483-9207-a54247413234 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:13.989575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d801ac67-cd1f-4483-9207-a54247413234 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:14.015288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d801ac67-cd1f-4483-9207-a54247413234 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1215 microversion: 2.1 time: 0.163643 Aug 10 10:03:14.018831 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:13 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:14.591792 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-927024775", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:14.881088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.network.neutron [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] validate_networks() for [('17c8f29a-7fae-4dd5-b45d-4f577fc49244', None, None, None, None, None)] {{(pid=117895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:03:15.037012 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:15.038165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:15.051664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:15.058709 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:15.063828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:15.066407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:15.067120 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:15.068275 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:15.852601 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:15.883965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6019f797-2710-4746-b57d-3cca1f100684 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1211 microversion: 2.1 time: 0.848024 Aug 10 10:03:15.888025 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:15 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1211 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:16.906146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:16.906930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:16.914329 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:16.922214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:16.923017 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:16.928882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:16.936788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:16.937698 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:17.120031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:17.128699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-51816eec-b387-47af-9b7c-567334c56890 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1273 microversion: 2.1 time: 0.226842 Aug 10 10:03:17.138203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:16 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:18.156523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:18.157674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:18.200667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:18.204268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:18.210249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:18.214553 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:18.217780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Flavor limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:03:18.219346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Image limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:03:18.220159 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Flavor pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:03:18.220406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:18.220735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Image pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:03:18.221199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:03:18.222316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:18.265092 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:18.265850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:18.270776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:18.277762 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:18.280923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:18.281378 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:18.444495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for project fbbf8047a09b4fee9a12288ef323338c. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:03:18.483388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for user befbca3738f0481296b63c70d6d2a797 and project fbbf8047a09b4fee9a12288ef323338c. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:03:18.571325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Going to run 1 instances... {{(pid=117895) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:03:18.582994 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:03:18.586450 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:18.608131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a7ac7afb-4ed8-4f51-9d5d-97bfa32cc4c7 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1273 microversion: 2.1 time: 0.458053 Aug 10 10:03:18.617658 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 14/26] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:18 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1273 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:18.694830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2110104225", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0883fa82-bc1b-403f-a6c6-d9e718def253"}], "security_groups": [{"name": "tempest-securitygroup--483333482"}], "key_name": "tempest-keypair-309494928", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:18.915984 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cbb16153-0fd6-4952-b025-da3f855609a5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.692432 Aug 10 10:03:18.924228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 13/27] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:03:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:03:18.929757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-67b1049f-4c3f-4f8f-8284-07ba52ac4bf7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:18.938389 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-67b1049f-4c3f-4f8f-8284-07ba52ac4bf7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:19.241505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-67b1049f-4c3f-4f8f-8284-07ba52ac4bf7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:19.261994 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] validate_networks() for [('0883fa82-bc1b-403f-a6c6-d9e718def253', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:03:19.278186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-67b1049f-4c3f-4f8f-8284-07ba52ac4bf7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1221 microversion: 2.1 time: 0.352536 Aug 10 10:03:19.305302 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:18 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1221 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:19.640508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:19.641131 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:19.663163 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:19.666440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:19.667894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:19.668661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:19.669143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:19.669572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:20.274124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:20.304957 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2275190a-ddf5-45d6-8706-332e5c3be475 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1273 microversion: 2.1 time: 0.668605 Aug 10 10:03:20.319045 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:19 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1273 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:20.324344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-829344068", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:20.527220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.network.neutron [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] validate_networks() for [('17c8f29a-7fae-4dd5-b45d-4f577fc49244', None, None, None, None, None)] {{(pid=117895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:03:21.338165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:03:21.339320 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:03:21.340408 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:03:21.341054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:03:21.343042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:03:21.360675 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:21.364066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:21.365378 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:21.369389 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:21.371273 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:21.371905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:21.423909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:03:21.435354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:03:21.452457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:03:21.454918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:03:21.590229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-84b3d6d4-efc8-4b3e-b54e-1504e495fc03 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.907692 Aug 10 10:03:21.599117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 15/30] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:03:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 2918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 10:03:21.607407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:21.608832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:21.630906 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:21.633575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:21.642593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:21.656306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:21.660415 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:21.661536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:22.679000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:22.689681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5fb00e5f-039c-4696-ab5e-0c8b39f48e1b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 1.089037 Aug 10 10:03:22.690449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:21 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:22.720058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-42c48c1a-5413-4140-9886-7fbd0a2ad13b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:22.720672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-42c48c1a-5413-4140-9886-7fbd0a2ad13b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:22.812024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Flavor limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:03:22.813351 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Image limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:03:22.814374 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Flavor pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:03:22.815052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Image pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:03:22.815749 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:03:22.850220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:22.856539 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:22.858063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:22.859824 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:22.864262 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:22.866914 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:22.921374 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for project fbbf8047a09b4fee9a12288ef323338c. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:03:22.929065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for user befbca3738f0481296b63c70d6d2a797 and project fbbf8047a09b4fee9a12288ef323338c. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:03:22.952769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Going to run 1 instances... {{(pid=117895) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:03:22.956630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:03:23.000742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-42c48c1a-5413-4140-9886-7fbd0a2ad13b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:23.011432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-42c48c1a-5413-4140-9886-7fbd0a2ad13b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1241 microversion: 2.1 time: 0.295948 Aug 10 10:03:23.016792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 17/32] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:22 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1241 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:23.134200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e7635d03-862b-4eb8-9596-cec061ea17a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.807652 Aug 10 10:03:23.140300 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 16/33] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:03:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:03:23.156393 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-39f71301-cfc3-4dc5-96b4-bb4ea86c9451 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:23.160013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-39f71301-cfc3-4dc5-96b4-bb4ea86c9451 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:23.378759 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-39f71301-cfc3-4dc5-96b4-bb4ea86c9451 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:23.411723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-39f71301-cfc3-4dc5-96b4-bb4ea86c9451 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1221 microversion: 2.1 time: 0.255901 Aug 10 10:03:23.416986 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 18/34] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:23 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:23.722823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:23.725620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:23.741108 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:23.743943 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:23.744597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:23.747333 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:23.748934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:23.751308 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:24.037833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:24.038521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:24.041154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:24.062988 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:24.066161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-958f7b7e-d0ff-4522-acb8-19dcb10ca62b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.353239 Aug 10 10:03:24.067288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:24.080464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:24.080464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:24.080464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:24.080464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:24.082178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:23 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:24.288288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:24.301978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cf7f67be-85d0-4bc2-b9d0-c4875ee25b36 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1293 microversion: 2.1 time: 0.268431 Aug 10 10:03:24.306746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 19/36] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:24 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1293 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:24.440670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:24.441352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:24.470134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:24.472973 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:24.473404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:24.478937 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:24.486130 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:24.487868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:24.739707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:24.757098 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f03ea10a-f6c8-46e8-a111-9161e425bb1b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1225 microversion: 2.1 time: 0.318979 Aug 10 10:03:24.760821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 18/37] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:24 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1225 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:25.102971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:25.109008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:25.149183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:25.154270 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:25.156405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:25.160510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:25.164186 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:25.164891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:25.340550 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:25.341242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:25.368108 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:25.368677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:25.372383 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:25.376477 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:25.379672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:25.381621 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:25.670388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:25.687406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4d02f450-425a-4fa7-b3ac-291baa5913ff tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1299 microversion: 2.1 time: 0.353554 Aug 10 10:03:25.697694 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:25 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1299 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:25.784966 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:25.785585 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:25.800809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:25.808228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:25.809058 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:25.810034 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:25.817821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:25.821004 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:26.118212 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:26.133237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-debc422c-b944-48c1-b84c-bec84ee9ae79 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1273 microversion: 2.1 time: 0.354703 Aug 10 10:03:26.140930 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:25 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1273 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:26.489632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:26.498384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0ca5f80e-b080-4d60-8848-c3a01daa8e6f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 1.414087 Aug 10 10:03:26.508383 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:25 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:26.718672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:26.719435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:26.736127 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:26.736680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:26.738286 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:26.739083 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:26.747515 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:26.748254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:27.161915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:27.162542 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:27.175699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:27.176210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:27.180561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:27.211816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:27.216823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:27.218178 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:27.225100 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:27.240180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3727d00e-def6-4f0e-adee-14106f0b6b09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1299 microversion: 2.1 time: 0.528076 Aug 10 10:03:27.246987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:26 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1299 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:27.529186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:27.530056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:27.542834 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:27.546264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:27.547997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:27.550617 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:27.554972 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:27.555146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:27.555642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:27.582566 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4dd2e81f-d04a-4672-8ef0-ef14f7d14f6e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1279 microversion: 2.1 time: 0.416026 Aug 10 10:03:27.588016 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:27 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1279 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:28.099533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:28.119146 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e78dc1b8-8dfa-47bb-ae2b-4154aad95b20 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.594142 Aug 10 10:03:28.134663 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:27 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:28.272887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:28.273582 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:28.281731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:28.282281 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:28.282832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:28.290074 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:28.290691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:28.291225 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:28.420538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-b0d3ca47-577b-4f02-ab8a-dfcc4cefa19b req-6d86369b-973f-4277-a923-8cf3f6fdbea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599abfa0-b16b-45c9-bf6a-f2798f1f49ee", "tag": "ca8310e3-db1e-4840-90a0-bef8820f4a41"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:28.444065 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b0d3ca47-577b-4f02-ab8a-dfcc4cefa19b req-6d86369b-973f-4277-a923-8cf3f6fdbea3 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:28.447640 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b0d3ca47-577b-4f02-ab8a-dfcc4cefa19b req-6d86369b-973f-4277-a923-8cf3f6fdbea3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:28.448345 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b0d3ca47-577b-4f02-ab8a-dfcc4cefa19b req-6d86369b-973f-4277-a923-8cf3f6fdbea3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:28.495350 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-b0d3ca47-577b-4f02-ab8a-dfcc4cefa19b req-6d86369b-973f-4277-a923-8cf3f6fdbea3 service nova] Creating event network-changed:ca8310e3-db1e-4840-90a0-bef8820f4a41 for instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee on hv-cinder-85083 Aug 10 10:03:28.496139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b0d3ca47-577b-4f02-ab8a-dfcc4cefa19b req-6d86369b-973f-4277-a923-8cf3f6fdbea3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 10:03:28.496686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b0d3ca47-577b-4f02-ab8a-dfcc4cefa19b req-6d86369b-973f-4277-a923-8cf3f6fdbea3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 10:03:28.497989 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:28.499554 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:28.511828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:28.512978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:28.514150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:28.514747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:28.525242 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.compute.rpcapi [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 10:03:28.530091 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] Releasing lock "compute-rpcapi-router" {{(pid=117896) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 10:03:28.568742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f06427ab-e4ee-48ad-b65a-0d9961649399 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.506944 Aug 10 10:03:28.570189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 22/44] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:28.611262 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:28.612125 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:28.624434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:28.626275 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:28.627002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:28.631409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:28.632150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:28.632862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:28.856478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:28.869017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b2031305-7bed-4c75-81f9-488f692d4d29 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1299 microversion: 2.1 time: 0.597618 Aug 10 10:03:28.893718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 23/45] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:28 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1299 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:28.919919 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:28.930357 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6cc91184-00bb-477f-9565-adece620f0e7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1279 microversion: 2.1 time: 0.324028 Aug 10 10:03:28.945414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 23/46] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:28 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1279 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:29.141787 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:29.142569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:29.148928 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:29.149427 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:29.150041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:29.151678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:29.152302 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:29.152970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:29.411845 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:29.424837 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-275ce5ff-2ce7-48da-848f-f884a643b6b6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.287777 Aug 10 10:03:29.425898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 24/47] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:29 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:29.894029 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:29.895734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:29.917168 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:29.917816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:29.921196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:29.922196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:29.922848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:29.926290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:29.967816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:29.968429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:29.985251 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:29.985955 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:29.989228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:29.990262 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:29.992936 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:29.993663 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:30.224027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:30.237549 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-10fadf4f-fee8-47dc-97b1-a63106ca5234 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.269577 Aug 10 10:03:30.252121 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:29 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:30.364212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:30.388438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a75993f5-dbcd-4f8a-94e5-de5b99ab33ee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.501450 Aug 10 10:03:30.389982 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 24/49] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:29 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:30.450194 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:30.450846 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:30.456885 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:30.457370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:30.457812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:30.458508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:30.458989 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:30.459415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:30.604660 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:30.613430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8293c88e-2972-4b46-8bc1-0de69fbe128e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.168095 Aug 10 10:03:30.614008 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 26/50] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:30 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:30.632612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-7afc2ed7-b43e-40ad-a254-36d8ea349058 req-4da72135-0ac4-481a-b221-408dd98f174a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7915e13-08f0-47b2-a0a9-334681c80ae6", "tag": "06190a57-126a-4a49-860c-55c34d96ec18"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:30.645254 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-7afc2ed7-b43e-40ad-a254-36d8ea349058 req-4da72135-0ac4-481a-b221-408dd98f174a service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:30.645848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-7afc2ed7-b43e-40ad-a254-36d8ea349058 req-4da72135-0ac4-481a-b221-408dd98f174a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:30.646283 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-7afc2ed7-b43e-40ad-a254-36d8ea349058 req-4da72135-0ac4-481a-b221-408dd98f174a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:30.657674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-7afc2ed7-b43e-40ad-a254-36d8ea349058 req-4da72135-0ac4-481a-b221-408dd98f174a service nova] Creating event network-changed:06190a57-126a-4a49-860c-55c34d96ec18 for instance a7915e13-08f0-47b2-a0a9-334681c80ae6 on hv-cinder-85083 Aug 10 10:03:30.663093 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-7afc2ed7-b43e-40ad-a254-36d8ea349058 req-4da72135-0ac4-481a-b221-408dd98f174a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034523 Aug 10 10:03:30.664183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 25/51] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:31.270023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:31.271676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:31.286218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:31.286882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:31.287536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:31.288757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:31.289399 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:31.289981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:31.425285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:31.425285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:31.438718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:31.439251 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:31.442126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:31.443870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:31.444634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:31.445209 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:31.634363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:31.646980 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ae837d0f-ce32-4926-8545-a0d02ff7c1d8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.380126 Aug 10 10:03:31.647945 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 27/52] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:31 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:31.660543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:31.662559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:31.674858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:31.676108 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:31.676782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:31.677759 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:31.679961 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:31.680691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:32.095049 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:32.119514 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fb9930c4-eba2-4bf2-8422-cd954739f8e7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.700554 Aug 10 10:03:32.141883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 26/53] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:31 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:32.244999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:32.258344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ce47747c-3775-4ada-997f-6ad8cec9d0c2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.604638 Aug 10 10:03:32.273087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 28/54] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:31 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:32.671108 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:32.672160 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:32.686592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:32.687449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:32.688109 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:32.689258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:32.689906 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:32.690531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.079935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:33.091233 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f46f79ea-fe82-47a8-8b58-30f2862e2933 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.424599 Aug 10 10:03:33.094334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 27/55] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:32 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:33.150676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:33.151446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:33.159286 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=4 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:33.163251 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=20 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:33.175533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:33.176623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:33.178693 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.181256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:33.182852 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:33.184780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.286056 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:33.286910 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:33.293270 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:33.293998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:33.294617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.295624 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:33.296224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:33.296798 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.405216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=18 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:33.521303 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:33.530331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4c5442d1-e850-444a-9bab-aee74a1270e8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.384693 Aug 10 10:03:33.530915 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 29/56] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:33 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:33.622248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:33.635533 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-68df8e5d-5ac8-4c25-b618-04041e7367a8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.353038 Aug 10 10:03:33.636137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 28/57] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:33 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:33.769385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-251235ef-4be9-42b4-8788-43c3fa15a145 req-31825cd4-89c1-417a-8611-2b71a9128612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e73da8d-056c-499b-8799-94fd26c5de12", "tag": "6b1b0b3d-4aff-41fe-ae46-b28d7b0a8d2e"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:33.798366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-251235ef-4be9-42b4-8788-43c3fa15a145 req-31825cd4-89c1-417a-8611-2b71a9128612 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:33.799170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-251235ef-4be9-42b4-8788-43c3fa15a145 req-31825cd4-89c1-417a-8611-2b71a9128612 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:33.799769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-251235ef-4be9-42b4-8788-43c3fa15a145 req-31825cd4-89c1-417a-8611-2b71a9128612 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.846530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-251235ef-4be9-42b4-8788-43c3fa15a145 req-31825cd4-89c1-417a-8611-2b71a9128612 service nova] Creating event network-changed:6b1b0b3d-4aff-41fe-ae46-b28d7b0a8d2e for instance 1e73da8d-056c-499b-8799-94fd26c5de12 on hv-cinder-85083 Aug 10 10:03:33.847438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-251235ef-4be9-42b4-8788-43c3fa15a145 req-31825cd4-89c1-417a-8611-2b71a9128612 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 10:03:33.847964 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-251235ef-4be9-42b4-8788-43c3fa15a145 req-31825cd4-89c1-417a-8611-2b71a9128612 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 10:03:33.849431 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:33.850809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:33.851560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.852433 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:33.853038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:33.853614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:33.866290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.compute.rpcapi [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 10:03:33.867613 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] Releasing lock "compute-rpcapi-router" {{(pid=117895) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 10:03:33.898929 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-62578a1b-3364-46c5-bafc-39a766c5d11b None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147453 Aug 10 10:03:33.899923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:03:34.047086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-817f7780-3747-4569-b4d7-7b91b9791261 req-b85f8be1-52c9-42b3-8323-da1ca5debcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50513b4b-53a2-4825-821b-07ff035fe17c", "tag": "96d57bd3-ced6-4c5a-bddb-15f267527a3d"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:34.057325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-817f7780-3747-4569-b4d7-7b91b9791261 req-b85f8be1-52c9-42b3-8323-da1ca5debcd0 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:34.057998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-817f7780-3747-4569-b4d7-7b91b9791261 req-b85f8be1-52c9-42b3-8323-da1ca5debcd0 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:34.059011 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-817f7780-3747-4569-b4d7-7b91b9791261 req-b85f8be1-52c9-42b3-8323-da1ca5debcd0 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:34.083818 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-817f7780-3747-4569-b4d7-7b91b9791261 req-b85f8be1-52c9-42b3-8323-da1ca5debcd0 service nova] Creating event network-changed:96d57bd3-ced6-4c5a-bddb-15f267527a3d for instance 50513b4b-53a2-4825-821b-07ff035fe17c on hv-cinder-85083 Aug 10 10:03:34.090569 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-817f7780-3747-4569-b4d7-7b91b9791261 req-b85f8be1-52c9-42b3-8323-da1ca5debcd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117641 Aug 10 10:03:34.096544 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 29/59] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:34.116516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:34.117334 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:34.132105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:34.132899 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:34.135553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:34.136479 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:34.137114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:34.138866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:34.313401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:34.322474 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-910dcfda-816f-4344-a9f5-8ec45296744e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.211607 Aug 10 10:03:34.323723 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 31/60] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:34 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:34.551787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:34.552557 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:34.558476 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:34.559170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:34.559779 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:34.560542 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:34.561158 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:34.561733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:34.661496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:34.662120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:34.668045 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:34.668503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:34.668940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:34.670160 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:34.670618 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:34.671099 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:34.675278 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:34.759662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:34.767557 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1bc0542c-b205-4bfb-8b6a-45d0656c8780 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.219866 Aug 10 10:03:34.768139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 30/61] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:34 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:34.859612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:34.866831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bb8784e2-85af-4bb9-91ce-989279f5811f tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.209249 Aug 10 10:03:34.867436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 32/62] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:34 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:35.346311 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:35.347128 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:35.356911 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:35.358325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:35.358433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:35.359245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:35.359766 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:35.360915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:35.525918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:35.541224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cd64f051-93e1-4fcf-be2b-205dff91ed26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.199166 Aug 10 10:03:35.541971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:35 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:35.787922 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:35.788571 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:35.794379 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:35.795456 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:35.795897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:35.796585 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:35.797059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:35.797494 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:35.887551 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:35.888163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:35.894840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:35.895362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:35.895806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:35.896499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:35.897115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:35.897546 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:35.917992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:35.931119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:35.938584 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4b0681ad-ff1d-4153-8402-13c3fce50901 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.154483 Aug 10 10:03:35.939195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 33/64] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:35 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:36.036020 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:36.044243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-67f11f5c-5a1d-4687-996e-033e83a840d6 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.160476 Aug 10 10:03:36.045474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 32/65] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:35 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:36.567514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:36.568138 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:36.574927 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:36.575529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:36.576110 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:36.576907 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:36.577588 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:36.578091 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:36.721694 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:36.729819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-959375f8-717b-4afb-a59e-e2c6df1e7d22 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.166436 Aug 10 10:03:36.731127 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:36 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:36.960058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:36.960694 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:36.967097 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:36.967568 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:36.968008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:36.968685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:36.969135 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:36.969559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:37.065572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:37.066187 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:37.068123 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:37.074180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:37.074691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:37.075188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:37.075917 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:37.076372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:37.076791 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:37.096760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:37.104169 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e87000ec-481a-4256-90f6-4f8539c5458c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.147897 Aug 10 10:03:37.104734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 33/67] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:36 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:37.215354 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:37.223173 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-06f68daf-1d97-4408-ba55-024c158f6d26 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.161430 Aug 10 10:03:37.223740 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:37 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:37.754150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:37.754764 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:37.760905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:37.761384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:37.761819 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:37.762498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:37.762972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:37.764005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:37.891248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:37.898523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-700a6556-2652-40d3-b9d7-2bc2b90e901e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.148448 Aug 10 10:03:37.899113 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:37 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:38.125087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:38.125955 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:38.132141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:38.132632 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:38.133072 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:38.133770 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:38.134230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:38.136346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:38.244690 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:38.245312 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:38.252355 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:38.252867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:38.253504 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:38.254559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:38.255054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:38.255487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:38.524463 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:38.538052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:38.545310 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-96903a86-ea62-421a-89e0-9a042e8e0266 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.424695 Aug 10 10:03:38.545883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 36/70] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:38 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:38.564841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:38.572535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3bc29e88-0797-41b7-af03-4434cb4e28f9 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.331875 Aug 10 10:03:38.573211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 35/71] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:38 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:38.920681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:38.921440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:38.927420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:38.928029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:38.928635 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:38.929437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:38.930120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:38.930832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:39.095094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:39.105666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e824661e-0b0f-4d65-a437-789910256e66 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.190587 Aug 10 10:03:39.107723 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 37/72] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:38 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:39.571612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:39.572224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:39.574068 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:39.587975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:39.588506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:39.595814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:39.596934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:39.605575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:39.608088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:39.610406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:39.611010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:39.617969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:39.618928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:39.620550 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:39.621730 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:39.622350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:39.624220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:39.990150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:39.998464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-06b09896-0f70-4952-9d17-6fe8891c9cf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.430648 Aug 10 10:03:40.015586 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 36/73] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:39 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:40.016158 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:40.019322 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a8bfd8ed-3b90-4864-99c8-5771e96e7bf4 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.426619 Aug 10 10:03:40.019322 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 38/74] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:39 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:40.144972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:40.146070 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:40.154538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:40.155245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:40.155843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:40.156688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:40.157287 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:40.157875 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:40.484462 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:40.505990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-78f5a1a7-8adf-4c0b-8c0c-397a38a0b231 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.364239 Aug 10 10:03:40.515166 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 37/75] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:40 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:41.030100 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:41.033449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:41.043347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:41.044985 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:41.069412 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:41.072860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:41.080005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:41.081279 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:41.083418 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:41.084785 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:41.085861 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:41.087250 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:41.089089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:41.089577 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:41.090084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:41.090539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:41.831743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:41.856939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c8ec6279-409b-4aa7-86d0-7c987ead45e2 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.819159 Aug 10 10:03:41.861650 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 38/76] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:41 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:41.896484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:41.898017 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:41.921604 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:41.923206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:41.924219 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:41.927474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:41.928482 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:41.932304 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:42.064477 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:42.077076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7bdefbf6-6b08-44c8-a6cb-642a0d9920fa tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 1.056732 Aug 10 10:03:42.078154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 39/77] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:41 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:42.227913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:42.236628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3ad0e93e-acf1-45a1-b8cb-17203275dc2f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.373807 Aug 10 10:03:42.252752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:41 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:42.889097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:42.892935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:42.904513 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:42.906797 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:42.908343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:42.910985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:42.912504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:42.914056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:43.098648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:43.099768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:43.120510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:43.124576 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:43.127504 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:43.128863 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:43.131767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:43.136783 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:43.205621 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:43.228755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-63e53151-df43-45b7-840e-c292565108f1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.347482 Aug 10 10:03:43.229530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 40/79] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:42 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:43.263310 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:43.264161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:43.280809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:43.284373 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:43.285744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:43.288115 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:43.291385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:43.291649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:43.647865 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:43.658982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:43.671133 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-09fe2fde-a685-4aa9-93df-70f0c9d89841 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.576697 Aug 10 10:03:43.671738 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 40/80] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:43 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:43.683261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b60ea05b-9f82-4764-b372-c9e3da94eb9a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.425196 Aug 10 10:03:43.684462 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 41/81] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:43 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:44.250143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:44.251305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:44.276529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:44.278719 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:44.279419 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:44.280395 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:44.281671 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:44.285283 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:44.554084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:44.565421 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4a9cbf37-c397-419a-91d7-ba24b1b19944 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.319292 Aug 10 10:03:44.566734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:44 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:44.714148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:44.715365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:44.720235 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:44.737500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:44.739155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:44.766168 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:44.766812 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:44.768731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:44.769877 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:44.771291 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:44.772450 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:44.773891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:44.774605 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:44.777664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:44.778642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:44.779333 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:44.779981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:45.056479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:45.066928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-314d0ea0-2a38-45ba-81f5-e70e8d8b019b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.356871 Aug 10 10:03:45.080048 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 42/83] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:44 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:45.082061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:45.089241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-13b86883-3a2c-439d-a4a5-2101345dae04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.383282 Aug 10 10:03:45.090071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:44 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:45.593644 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:45.594631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:45.601289 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:45.602129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:45.603132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:45.604214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:45.604857 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:45.605612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:45.771416 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:45.782947 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ed2c4fb4-b011-4a80-a126-de3be8ad7d52 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.195644 Aug 10 10:03:45.785178 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:45 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:46.094643 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:46.096600 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:46.104092 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:46.104972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:46.105675 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:46.106864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:46.107596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:46.108255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:46.291233 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:46.306772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-95ceb382-c321-467b-a5aa-fcad44d5c8ef tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.220779 Aug 10 10:03:46.307702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 44/86] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:46 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:46.314278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:46.315075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:46.322633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:46.323285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:46.323966 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:46.324868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:46.326551 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:46.327179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:46.527905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:46.538694 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-13fffa33-50cf-4564-a54f-9f5e24fcf154 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.228407 Aug 10 10:03:46.539942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 45/87] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:46 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:46.577014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-a4448c5f-8ec5-41ff-a1ad-e01a229bb4e7 req-89a4a186-42d2-4fa8-8e8d-0f84f010b12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599abfa0-b16b-45c9-bf6a-f2798f1f49ee", "name": "network-vif-plugged", "status": "completed", "tag": "ca8310e3-db1e-4840-90a0-bef8820f4a41"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:46.587166 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-a4448c5f-8ec5-41ff-a1ad-e01a229bb4e7 req-89a4a186-42d2-4fa8-8e8d-0f84f010b12a service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:46.587601 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-a4448c5f-8ec5-41ff-a1ad-e01a229bb4e7 req-89a4a186-42d2-4fa8-8e8d-0f84f010b12a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:46.588779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-a4448c5f-8ec5-41ff-a1ad-e01a229bb4e7 req-89a4a186-42d2-4fa8-8e8d-0f84f010b12a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:46.601743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-a4448c5f-8ec5-41ff-a1ad-e01a229bb4e7 req-89a4a186-42d2-4fa8-8e8d-0f84f010b12a service nova] Creating event network-vif-plugged:ca8310e3-db1e-4840-90a0-bef8820f4a41 for instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee on hv-cinder-85083 Aug 10 10:03:46.607576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-a4448c5f-8ec5-41ff-a1ad-e01a229bb4e7 req-89a4a186-42d2-4fa8-8e8d-0f84f010b12a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.524331 Aug 10 10:03:46.611004 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 43/88] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:46.804664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:46.805580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:46.818628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:46.820374 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:46.822607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:46.823388 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:46.823851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:46.824286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:47.087353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:47.099264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-368d67a5-213e-4b2f-ad45-05b07ddee97e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.298633 Aug 10 10:03:47.116758 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 46/89] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:46 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:47.333673 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:47.336517 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:47.353972 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:47.354489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:47.354999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:47.355714 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:47.360339 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:47.361005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:47.549953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:47.557991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8ce412b4-4868-43ec-a0b8-12f67a5ecff0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.231939 Aug 10 10:03:47.558649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 44/90] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:47 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:47.564949 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:47.565577 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:47.572053 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:47.572866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:47.573561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:47.574261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:47.574795 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:47.575299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:47.748330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:47.755885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-66a70c3c-08c9-4c20-9c86-b4a7aefccb14 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.195977 Aug 10 10:03:47.756809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 47/91] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:47 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:48.134203 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:48.135978 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:48.147914 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:48.149263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:48.150203 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:48.150645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:48.151165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:48.152865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:48.365654 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:48.374094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7eb99652-b9f5-4759-83ae-307950168d1e tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.249670 Aug 10 10:03:48.374751 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:48 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:48.582473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:48.583152 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:48.589159 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:48.589649 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:48.590094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:48.590801 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:48.591879 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:48.592449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:48.622934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e73da8d-056c-499b-8799-94fd26c5de12", "name": "network-vif-plugged", "status": "completed", "tag": "6b1b0b3d-4aff-41fe-ae46-b28d7b0a8d2e"}, {"server_uuid": "a7915e13-08f0-47b2-a0a9-334681c80ae6", "name": "network-vif-plugged", "status": "completed", "tag": "06190a57-126a-4a49-860c-55c34d96ec18"}, {"server_uuid": "50513b4b-53a2-4825-821b-07ff035fe17c", "name": "network-vif-plugged", "status": "completed", "tag": "96d57bd3-ced6-4c5a-bddb-15f267527a3d"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:48.640365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:48.640928 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:48.641372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:48.659870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] Creating event network-vif-plugged:6b1b0b3d-4aff-41fe-ae46-b28d7b0a8d2e for instance 1e73da8d-056c-499b-8799-94fd26c5de12 on hv-cinder-85083 Aug 10 10:03:48.660563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] Creating event network-vif-plugged:06190a57-126a-4a49-860c-55c34d96ec18 for instance a7915e13-08f0-47b2-a0a9-334681c80ae6 on hv-cinder-85083 Aug 10 10:03:48.662145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] Creating event network-vif-plugged:96d57bd3-ced6-4c5a-bddb-15f267527a3d for instance 50513b4b-53a2-4825-821b-07ff035fe17c on hv-cinder-85083 Aug 10 10:03:48.673903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-99c8607e-d713-4c82-9239-54f08c8330c6 req-bec318c6-e716-408a-9d57-0f6efbad88d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055248 Aug 10 10:03:48.675013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 46/93] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:03:48.780184 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:48.781061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:48.798870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:48.808879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:48.809054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:48.811996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:48.814640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:48.816983 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:48.818646 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:48.825377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e1a02a61-91f1-4a10-bf62-5f33fc1ef17c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.247605 Aug 10 10:03:48.826128 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 48/94] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:48 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:49.054463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:49.064498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b024fbc7-2329-4d59-b0b4-45a9b7a990b8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.290949 Aug 10 10:03:49.065761 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 47/95] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:48 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:49.400175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:49.401090 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:49.418229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:49.420353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:49.421607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:49.425268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:49.429866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:49.430412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:49.482934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:49.775528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:49.787127 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-04ba42b3-1474-49e7-b1ef-038f7d936d30 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1315 microversion: 2.1 time: 0.393338 Aug 10 10:03:49.788096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 49/96] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:49 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:49.853416 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:49.856099 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:49.864973 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:49.865782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:49.866543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:49.875230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:49.876287 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:49.877000 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:50.088483 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:50.089795 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:50.103020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:50.105269 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:50.105865 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:50.108548 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:50.109535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:50.110474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:50.111954 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:50.114792 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-57d2fed8-b87d-4d62-b1c9-978685cb145d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.271573 Aug 10 10:03:50.115857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 48/97] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:49 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:50.363478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:50.375057 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-02dd511d-6601-4f4d-b9a1-342e780dd290 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.290469 Aug 10 10:03:50.376255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 50/98] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:50 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:50.810559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:50.811434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:50.820057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:50.821041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:50.821819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:50.822718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:50.823748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:50.824309 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:51.023036 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:51.035950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0acd3ceb-b7c0-46b2-a67c-0acc368b714b tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1503 microversion: 2.1 time: 0.231310 Aug 10 10:03:51.051462 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:50 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:51.139656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:51.140211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:51.146768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:51.147330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:51.147767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:51.148466 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:51.148919 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:51.149421 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:51.370526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:51.380241 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-39603753-516d-4b0f-afa0-6561de5c7df2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.246266 Aug 10 10:03:51.394223 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 51/100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:51 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:51.406850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:51.407713 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:51.426892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:51.427427 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:51.427869 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:51.428590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:51.429047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:51.429479 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:51.437015 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:51.627155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:51.637315 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-599be423-da75-4369-a53f-53a0e8d5748f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.236548 Aug 10 10:03:51.638529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:51 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:52.401605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:52.403409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:52.410367 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:52.410811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:52.411286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:52.412179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:52.413024 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:52.413616 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:52.567371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:52.576500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c62e4b29-2736-4840-a52e-c90027e546ab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.179584 Aug 10 10:03:52.590055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:52 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:52.660538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:52.661754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:52.669630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:52.670295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:52.670883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:52.671603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:52.672236 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:52.672801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:52.840096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:52.850885 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-de83f8a4-0b31-4f80-84cd-79822c07d0e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.195700 Aug 10 10:03:52.851707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:52 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:53.601184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:53.601691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:53.614376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:53.615288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:53.616084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:53.617102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:53.617765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:53.618377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:53.878594 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:53.878594 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:53.893623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:53.895570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:53.897404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:53.898244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:53.904822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:53.909261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:53.910467 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:53.910751 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-92a8a10e-d1bc-4aec-b9a6-90ad4955c13b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.316676 Aug 10 10:03:53.911532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 53/104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:53 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:54.155869 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:54.170078 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1ca2dc14-6990-4df8-9e6f-41a83ed0b8b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.301564 Aug 10 10:03:54.183543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 52/105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:53 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:54.933424 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:54.935379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:54.945449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:54.945947 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:54.946720 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:54.947469 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:54.947997 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:54.948347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:54.956594 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6417fa94-c2d6-47f8-86ff-9d30506a8b54"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:54.960113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:54.967199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:54.967889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:54.968728 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:54.969636 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:54.970400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:54.971043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:55.218126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:55.226771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-28d894b7-09c0-4e8c-881e-9843ff15b998 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.298283 Aug 10 10:03:55.227627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 54/106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:54 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:55.233075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:55.233682 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:55.239864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:55.240644 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:55.241295 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:55.242412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:55.243072 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:55.243657 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:55.413268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:55.426596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ab1bcdfa-4d7c-46bd-94fe-289d73335b87 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.197700 Aug 10 10:03:55.428438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 55/107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:55 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:56.252439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:56.254318 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:56.262493 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:56.263942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:56.264700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:56.265730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:56.266559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:56.267013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:56.398268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:56.407104 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f339ef13-36e8-44f1-97e9-cda99707060d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1321 microversion: 2.1 time: 0.161297 Aug 10 10:03:56.407888 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 56/108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:56 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:56.448593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:56.449200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:56.455134 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:56.455612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:56.456059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:56.456723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:56.457174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:56.457593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:56.600933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:56.610572 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-60e4bdd6-efd8-4c74-99d7-43a7cce63388 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1366 microversion: 2.1 time: 0.166009 Aug 10 10:03:56.611384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 57/109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:56 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:03:57.432846 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:57.434181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:57.454786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:57.455884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:57.457537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:57.459881 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:57.462071 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:57.463887 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:57.691439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:57.701094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-679cb1be-1bda-4dee-99a9-e94ac3da90ac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1514 microversion: 2.1 time: 0.272477 Aug 10 10:03:57.701844 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 58/110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:57 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:57.726618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-603512125", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "networks": [{"uuid": "49a83621-8ac5-43fa-b021-296a2b74428f"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:57.825717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] validate_networks() for [('49a83621-8ac5-43fa-b021-296a2b74428f', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:03:58.248499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:03:58.249102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:03:58.249627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:03:58.250045 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:03:58.250757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:03:58.264792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.265234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.265591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.266348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.266732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.267178 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.284264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Getting quotas for project 76f7f3766f4a44c4b3859b8199a670da. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:03:58.288237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Getting quotas for user 7ecb55aabbe64be7907123772c359287 and project 76f7f3766f4a44c4b3859b8199a670da. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:03:58.299390 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:03:58.301630 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:03:58.353176 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-abb22323-c709-4a58-bac2-d676c953589d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634057 Aug 10 10:03:58.353952 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 59/111] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:03:58.360068 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:58.360836 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:58.367268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.368093 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.368771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.369800 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.370502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.371162 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.588242 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:58.597230 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8effc2d1-9d43-489a-beae-14825960b3c0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1557 microversion: 2.1 time: 0.240805 Aug 10 10:03:58.599125 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 60/112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:58 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1557 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:58.604231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:03:58.607302 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:58.614480 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.615382 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.615950 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.617067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.617826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.618514 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.634918 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1523d466-52e7-4c5e-985f-0d8a7e1f61d3 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "POST /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.680316 Aug 10 10:03:58.635718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 53/113] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:03:54 2022] POST /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee/os-volume_attachments => generated 194 bytes in 3685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:03:58.645829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c20327d4-3860-4f99-bbbe-f9bca1c32b93 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:58.647558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c20327d4-3860-4f99-bbbe-f9bca1c32b93 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:58.708835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lazy-loading 'flavor' on Instance uuid 1e73da8d-056c-499b-8799-94fd26c5de12 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:03:58.763529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c20327d4-3860-4f99-bbbe-f9bca1c32b93 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:58.782580 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c20327d4-3860-4f99-bbbe-f9bca1c32b93 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1213 microversion: 2.1 time: 0.143382 Aug 10 10:03:58.784324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 54/114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:58 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:58.799062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:58.800048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:58.814703 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.815231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.818481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.820571 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.821052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.822774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.948639 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-de1cfe91-4b3c-43c7-9b72-7c4be74c8ef1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12/action" status: 200 len: 32 microversion: 2.1 time: 0.347714 Aug 10 10:03:58.950920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 61/115] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:03:58 2022] POST /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:03:58.967675 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:58.969044 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:58.974579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3e9a5f65-a57f-4d8c-b794-bc7d963a190b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188488 Aug 10 10:03:58.975204 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 55/116] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:03:58 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-interface => generated 285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:03:58.978717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.979801 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.980355 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:58.981185 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:58.982373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:58.982942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:59.710900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:03:59.721689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a8b769f5-015b-4b99-8e28-4213a5b23a74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.760887 Aug 10 10:03:59.722887 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 62/117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:58 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:03:59.811800 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:03:59.812524 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:03:59.824225 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:59.824949 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:59.826038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:03:59.826845 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:03:59.827348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:03:59.830670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:00.052294 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:00.064045 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-865bece5-e8e6-4203-a129-b5bcd60c76ba tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1265 microversion: 2.1 time: 0.256476 Aug 10 10:04:00.064928 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 56/118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:03:59 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:00.744387 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:00.745565 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:00.759119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:00.759831 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:00.760526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:00.761402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:00.763661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:00.764406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:01.089706 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:01.090304 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:01.097051 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:01.105566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:01.106399 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:01.107455 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:01.108100 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:01.108533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:01.355440 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:01.372708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-99c22e09-a65b-4558-9654-b0fc4dad8503 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.631580 Aug 10 10:04:01.373311 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 63/119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:00 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:01.467520 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:01.475475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7cd8686f-fa83-4c5a-b667-cbd5a6365ece tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.389444 Aug 10 10:04:01.478071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 57/120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:01 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:01.637576 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-39677fb0-bfdf-4473-877a-600a9a633cb6 req-6f45ba67-8922-428d-bde9-1625aaa246c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50513b4b-53a2-4825-821b-07ff035fe17c", "tag": "96d57bd3-ced6-4c5a-bddb-15f267527a3d"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:01.649748 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-39677fb0-bfdf-4473-877a-600a9a633cb6 req-6f45ba67-8922-428d-bde9-1625aaa246c2 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:01.650512 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-39677fb0-bfdf-4473-877a-600a9a633cb6 req-6f45ba67-8922-428d-bde9-1625aaa246c2 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:01.651129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-39677fb0-bfdf-4473-877a-600a9a633cb6 req-6f45ba67-8922-428d-bde9-1625aaa246c2 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:01.670816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-39677fb0-bfdf-4473-877a-600a9a633cb6 req-6f45ba67-8922-428d-bde9-1625aaa246c2 service nova] Creating event network-changed:96d57bd3-ced6-4c5a-bddb-15f267527a3d for instance 50513b4b-53a2-4825-821b-07ff035fe17c on hv-cinder-85083 Aug 10 10:04:01.678908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-39677fb0-bfdf-4473-877a-600a9a633cb6 req-6f45ba67-8922-428d-bde9-1625aaa246c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045307 Aug 10 10:04:01.681311 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 64/121] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 10 10:04:01.927680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-5341ec8d-bdcf-47f8-b479-018942752086 req-e1b4bd19-9337-4cee-b378-d6ee08ffa608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ee68991-bff4-4467-81c2-33a89fe97827", "tag": "0f8528cb-a4cb-45a5-bc66-313c4fcfb795"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:01.952227 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-5341ec8d-bdcf-47f8-b479-018942752086 req-e1b4bd19-9337-4cee-b378-d6ee08ffa608 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:01.953387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-5341ec8d-bdcf-47f8-b479-018942752086 req-e1b4bd19-9337-4cee-b378-d6ee08ffa608 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:01.954011 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-5341ec8d-bdcf-47f8-b479-018942752086 req-e1b4bd19-9337-4cee-b378-d6ee08ffa608 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:02.004922 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-5341ec8d-bdcf-47f8-b479-018942752086 req-e1b4bd19-9337-4cee-b378-d6ee08ffa608 service nova] Creating event network-changed:0f8528cb-a4cb-45a5-bc66-313c4fcfb795 for instance 1ee68991-bff4-4467-81c2-33a89fe97827 on hv-cinder-85083 Aug 10 10:04:02.019145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-5341ec8d-bdcf-47f8-b479-018942752086 req-e1b4bd19-9337-4cee-b378-d6ee08ffa608 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093311 Aug 10 10:04:02.019865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 58/122] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:02.394485 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:02.395226 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:02.406003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:02.413845 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:02.414310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:02.415538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:02.415538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:02.415970 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:02.476306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:02.505050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:02.506994 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:02.524763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:02.528786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:02.529424 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:02.530977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:02.531597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:02.534698 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:02.871377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:02.884039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-15fe53e1-6985-4442-b6ba-d747dfc356f4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.493840 Aug 10 10:04:02.885609 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 65/123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:02 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:02.922199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:02.941464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-824b5da6-60a2-4dc3-88da-cee3e45f797b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.443169 Aug 10 10:04:02.942052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 59/124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:02 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:03.907129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:03.907836 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:03.914560 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:03.915197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:03.915635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:03.916331 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:03.916780 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:03.917337 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:03.963505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:03.964182 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:03.972524 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:03.973330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:03.974101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:03.975044 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:03.975710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:03.976382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:04.214605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:04.239313 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1e9357b4-cd9e-4375-ab31-95a05bb9b85a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.336175 Aug 10 10:04:04.240238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 66/125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:03 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:04.289931 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:04.297982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-adb39a47-0137-4cf5-a9a0-b7eddfdc1604 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.338740 Aug 10 10:04:04.307940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 60/126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:03 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:05.263793 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:05.264752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:05.271460 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:05.271964 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:05.272408 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:05.273114 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:05.273607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:05.274043 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:05.333243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:05.333949 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:05.353060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:05.353586 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:05.354022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:05.354745 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:05.355490 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:05.356076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:05.452633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:05.464486 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-000e29fc-c4f2-4f79-b6f6-1cb2b0d6cc55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.205500 Aug 10 10:04:05.479479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 67/127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:05 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:05.537655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:05.549151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-eb0045f0-f39b-4ec3-8c74-db691a4e54d8 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.219683 Aug 10 10:04:05.549871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 61/128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:05 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:06.486171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:06.486788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:06.492820 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:06.493304 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:06.493744 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:06.494432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:06.494885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:06.495337 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:06.570039 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:06.570507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:06.577558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:06.578048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:06.578491 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:06.579286 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:06.579746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:06.580173 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:06.678269 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:06.687577 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e224c45d-dd66-42c9-a2a8-1db92b6454ea tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.205820 Aug 10 10:04:06.689117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 68/129] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:06 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:06.734981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:06.742275 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ea785a37-65ca-4121-acd0-a2a60e0ea2dc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.176615 Aug 10 10:04:06.744326 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 62/130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:06 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:07.708609 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:07.709219 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:07.715115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:07.715811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:07.716432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:07.717288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:07.717742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:07.718167 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:07.765243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:07.765979 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:07.769577 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=58 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:07.785277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:07.786006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:07.787993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:07.789929 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:07.790511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:07.791332 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:07.953332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:07.961198 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c9a1a6e0-de24-4404-90f9-e75b8c6a4723 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.256325 Aug 10 10:04:07.975355 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 69/131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:07 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:07.982361 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:07.990657 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-82325fba-d2ca-4079-aedd-41e042057955 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.230892 Aug 10 10:04:07.991266 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 63/132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:07 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:08.982480 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:08.983154 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:08.986197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:08.986869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:08.992068 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:08.992552 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:08.992988 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:08.993689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:08.994144 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:08.994566 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:09.019878 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:09.022050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:09.036558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:09.040471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:09.040994 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:09.041439 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:09.042162 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:09.042623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:09.043132 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:09.219816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:09.227857 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9e18a615-7a38-49c2-9b46-fc8fe458cbb1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.249428 Aug 10 10:04:09.228430 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 70/133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:08 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:09.247176 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:09.255125 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0b84fcd7-8847-4f69-aa5b-4c9b2b463626 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.245289 Aug 10 10:04:09.255772 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 64/134] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:09 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:09.341840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1329352565", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "networks": [{"uuid": "e7a27918-6d3b-4682-9cc8-50b91115fba4"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:09.396184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] validate_networks() for [('e7a27918-6d3b-4682-9cc8-50b91115fba4', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:04:09.745220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:04:09.745649 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:04:09.746126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:04:09.746546 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:04:09.747017 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:04:09.748975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:09.758583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:09.759086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:09.759528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:09.760258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:09.760717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:09.761147 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:09.779534 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Getting quotas for project 0c42b50ff98c40a6b2f47f289538a330. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:04:09.783625 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Getting quotas for user 55ae4dbafed74e9dbeab9538898cf1f6 and project 0c42b50ff98c40a6b2f47f289538a330. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:04:09.796551 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:04:09.798920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:04:09.849170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d59f5b10-a6f1-45b1-ae96-b1360c2d9572 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511353 Aug 10 10:04:09.850215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 71/135] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:04:09.866141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d30fc015-7530-4301-af42-8870acdce5a5 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:09.866764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d30fc015-7530-4301-af42-8870acdce5a5 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:09.937589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d30fc015-7530-4301-af42-8870acdce5a5 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:09.945862 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d30fc015-7530-4301-af42-8870acdce5a5 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1219 microversion: 2.1 time: 0.087456 Aug 10 10:04:09.947072 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 65/136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:09 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:10.250674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:10.252121 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:10.262893 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:10.267260 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:10.268256 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:10.275446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:10.276483 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:10.277329 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:10.277563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:10.280427 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:10.300945 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:10.301572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:10.305589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:10.306575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:10.309782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:10.311444 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:10.866648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:10.872389 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:10.875767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2237cf18-7d0c-4bf5-9716-b8411ef73740 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.630133 Aug 10 10:04:10.876488 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 72/137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:10 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:10.882442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-9dc1e14c-64dc-4472-8644-ea7ccbb069c7 req-2580c1c6-3c88-450c-900a-33b779f8e59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee68991-bff4-4467-81c2-33a89fe97827", "name": "network-vif-plugged", "status": "completed", "tag": "0f8528cb-a4cb-45a5-bc66-313c4fcfb795"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:10.895157 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dc1e14c-64dc-4472-8644-ea7ccbb069c7 req-2580c1c6-3c88-450c-900a-33b779f8e59b service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:10.895862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dc1e14c-64dc-4472-8644-ea7ccbb069c7 req-2580c1c6-3c88-450c-900a-33b779f8e59b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:10.895995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8cbeb57d-0f6c-4977-8a7b-b9a98ecd0749 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.623792 Aug 10 10:04:10.896640 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dc1e14c-64dc-4472-8644-ea7ccbb069c7 req-2580c1c6-3c88-450c-900a-33b779f8e59b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:10.896843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 66/138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:10 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:10.911496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-9dc1e14c-64dc-4472-8644-ea7ccbb069c7 req-2580c1c6-3c88-450c-900a-33b779f8e59b service nova] Creating event network-vif-plugged:0f8528cb-a4cb-45a5-bc66-313c4fcfb795 for instance 1ee68991-bff4-4467-81c2-33a89fe97827 on hv-cinder-85083 Aug 10 10:04:10.918757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-9dc1e14c-64dc-4472-8644-ea7ccbb069c7 req-2580c1c6-3c88-450c-900a-33b779f8e59b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040398 Aug 10 10:04:10.919520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 73/139] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:10.970448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:10.971429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:10.978740 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:10.979469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:10.980067 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:10.982359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:10.982944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:10.983573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:11.064918 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:11.072478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-404232c1-a6f9-4408-8753-af5bc8fefadd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1271 microversion: 2.1 time: 0.106790 Aug 10 10:04:11.073053 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 67/140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:10 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:11.898422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:11.899621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:11.916328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:11.917482 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:11.927376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:11.927880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:11.928327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:11.929024 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:11.929484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:11.929918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:11.933314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:11.933808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:11.934287 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:11.935025 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:11.935495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:11.935925 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:11.970382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:12.315871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:12.322750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:12.336753 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-50b50958-8d9c-4485-b8a6-59bfdd07f950 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.442380 Aug 10 10:04:12.341619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8396b9f8-aa96-4336-9f1b-31f4dfc34dee tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.421009 Aug 10 10:04:12.342020 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 74/141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:11 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:12.343117 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 68/142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:11 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:12.363354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:12.364140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:12.370853 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:12.371470 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:12.372095 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:12.372813 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:12.373248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:12.373676 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:12.459482 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:12.470460 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-99fba69a-ae35-4baf-8aaa-70763a85cd7b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1277 microversion: 2.1 time: 0.127157 Aug 10 10:04:12.471063 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 75/143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:12 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:13.358303 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:13.359042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:13.364882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:13.365642 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:13.373499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:13.374082 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:13.377804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:13.379686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:13.380379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:13.381182 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:13.381901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:13.382867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:13.383420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:13.383979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:13.385050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:13.387498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:13.748599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:13.759634 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b65641db-5409-431f-87d1-76a62c5630db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.405412 Aug 10 10:04:13.759962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 69/144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:13 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:13.780840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:13.783138 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:13.800566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:13.803830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:13.804284 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:13.805011 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:13.810601 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:13.811069 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:13.851963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:13.860278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-211524ad-78a5-4ae5-a5ca-38ecc75aae6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1313 microversion: 2.1 time: 0.499597 Aug 10 10:04:13.875304 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 76/145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:13 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:13.881202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-1c8591d5-262e-448a-bc19-5dc8be463aad req-dc0fd437-6a03-4b31-a2d9-4ee4c64a26c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8051dcee-4ed6-4b3d-87de-bc26e85c971e", "tag": "a3850c28-4943-4aa2-94d2-3dc9fe679ef9"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:13.893641 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1c8591d5-262e-448a-bc19-5dc8be463aad req-dc0fd437-6a03-4b31-a2d9-4ee4c64a26c6 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:13.894435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1c8591d5-262e-448a-bc19-5dc8be463aad req-dc0fd437-6a03-4b31-a2d9-4ee4c64a26c6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:13.895768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1c8591d5-262e-448a-bc19-5dc8be463aad req-dc0fd437-6a03-4b31-a2d9-4ee4c64a26c6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:13.910343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-1c8591d5-262e-448a-bc19-5dc8be463aad req-dc0fd437-6a03-4b31-a2d9-4ee4c64a26c6 service nova] Creating event network-changed:a3850c28-4943-4aa2-94d2-3dc9fe679ef9 for instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e on hv-cinder-85083 Aug 10 10:04:13.915751 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-1c8591d5-262e-448a-bc19-5dc8be463aad req-dc0fd437-6a03-4b31-a2d9-4ee4c64a26c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038460 Aug 10 10:04:13.916348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 77/146] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:13.999992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:14.011572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b813212e-d6b5-4456-8285-0881895b8eff tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.244343 Aug 10 10:04:14.014472 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 70/147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:13 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:14.793322 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:14.794124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:14.800336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:14.800821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:14.801453 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:14.802211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:14.803200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:14.803798 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:14.882027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:14.883286 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:14.890634 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:14.891506 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:14.892267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:14.893485 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:14.897072 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:14.897692 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:15.070218 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:15.079764 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-389911df-7f47-4a7e-bde9-120c234cc320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.290420 Aug 10 10:04:15.081169 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 78/148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:14 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:15.104979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:15.109992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:15.124789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:15.125814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:15.126451 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:15.128022 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:15.130130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:15.131070 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:15.133404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:15.143853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e86c3a63-770b-4532-94f0-0064e818945e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1495 microversion: 2.1 time: 0.264521 Aug 10 10:04:15.144426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 71/149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:14 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1495 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:15.369430 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:15.385118 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a8a3f442-5a94-4a0f-8723-18e27905e982 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.303097 Aug 10 10:04:15.386336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 79/150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:15 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:16.101443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:16.102066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:16.109119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.109631 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.110076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.110775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.111267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.111700 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.253524 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:16.261560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0e1d4c3e-b4ab-480a-a513-62055ce8a00c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.163968 Aug 10 10:04:16.262146 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 72/151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:16 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:16.408719 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:16.409417 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:16.415758 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.416268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.416700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.417395 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.417864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.418319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.458940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:16.458940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:16.463132 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.463762 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.464245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.465907 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.466748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.467211 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.494421 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:04:16.586576 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:16.594806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ba9c4f5a-9002-434d-9ee1-5a2eec926575 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.189718 Aug 10 10:04:16.595714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 80/152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:16 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:16.600725 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7f30d427-017d-42bc-9d7f-4f283f74d92d tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "DELETE /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 204 len: 0 microversion: 2.1 time: 0.150347 Aug 10 10:04:16.601607 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 73/153] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:04:16 2022] DELETE /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 10:04:16.613887 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:16.614491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:16.620281 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.620760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.621199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.621916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:16.622371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:16.622797 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:16.759146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:16.767772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f016265a-f353-4ef8-bb2b-4654eb0be5c8 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1555 microversion: 2.1 time: 0.157613 Aug 10 10:04:16.768345 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 81/154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:16 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:17.283428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:17.284131 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:17.290460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:17.290945 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:17.291415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:17.292106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:17.292563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:17.292991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:17.419671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:17.427167 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d239cf39-e569-460b-ab36-1cc382cdccf2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.147913 Aug 10 10:04:17.427735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 74/155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:17 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:17.616242 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:17.616854 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:17.623433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:17.623917 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:17.624358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:17.625055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:17.625803 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:17.626252 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:17.749265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:17.756878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-89a1e160-daa3-4c4b-a740-9406cf7e52b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.144486 Aug 10 10:04:17.757457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 82/156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:17 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:17.789391 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:17.790013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:17.795823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:17.796301 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:17.796738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:17.797418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:17.797870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:17.798290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:17.931162 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:17.939111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ba067fb9-1052-4253-89bc-b95b56015749 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1555 microversion: 2.1 time: 0.153516 Aug 10 10:04:17.939688 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 75/157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:17 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:18.447707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:18.448320 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:18.455522 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.456011 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.456437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:18.457275 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.457799 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.458231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:18.599435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:18.604262 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:18.624109 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5b84de88-9a0b-4f42-b73c-c977650ec508 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.180078 Aug 10 10:04:18.635139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:18.635139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:18.635139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.635139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.635936 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:18.635936 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.635936 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.636453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:18.637858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 83/158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:18 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:18.662469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:04:18.752087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8fc54fea-7a80-46ae-a30c-cf02916288c6 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 204 len: 0 microversion: 2.1 time: 0.129682 Aug 10 10:04:18.753206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 76/159] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:04:18 2022] DELETE /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:04:18.763973 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:18.764886 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:18.772144 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.772793 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.773553 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:18.774449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.775052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.775570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:18.778324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:18.779051 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:18.785655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.786386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.786830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:18.787579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:18.788034 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:18.788460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:19.007611 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:19.011391 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:19.021494 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2204a509-ce01-456f-8394-62f582f1a574 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.247324 Aug 10 10:04:19.022063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 77/160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:18 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:19.024778 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fa2c5dfd-ffc5-4da5-bf7f-be4bcf6ee183 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1501 microversion: 2.1 time: 0.266658 Aug 10 10:04:19.025342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 84/161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:18 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1501 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:19.026443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:19.027083 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:19.033576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:19.034129 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:19.034678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:19.035483 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:19.036022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:19.036451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:19.165150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:19.173001 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ad30a1dc-2dd0-4b81-9a8b-f2aff1fa92cc tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1555 microversion: 2.1 time: 0.150005 Aug 10 10:04:19.173609 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 78/162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:19 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:19.648377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:19.649181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:19.656200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:19.656692 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:19.657134 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:19.657942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:19.658436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:19.658870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:19.769339 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:19.792958 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:19.795826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:19.802050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fcc1067c-f70e-4a1f-b936-26f5155371e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.157626 Aug 10 10:04:19.802622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 85/163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:19 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:20.044586 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:20.045492 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:20.048747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:20.049427 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:20.053079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:20.056849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.057709 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.058094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.058317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.059977 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.060258 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.060444 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.060906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.061206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.062041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.064547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.065111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.488117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:20.497924 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9e4391c1-c106-45fe-b9c8-4e0d8c7f9ae4 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1501 microversion: 2.1 time: 0.455912 Aug 10 10:04:20.498701 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 86/164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:20 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1501 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:20.504163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:20.504469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:20.504878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:20.511292 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.511971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.512744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d45f25b6-c89e-44b9-bc2d-294eb21087cd tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.472664 Aug 10 10:04:20.513270 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 79/165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:20 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:20.515078 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.515078 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.515078 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.515349 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.653231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:20.662688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b9666b01-81ab-4985-8b5b-ecba44930638 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1555 microversion: 2.1 time: 0.162821 Aug 10 10:04:20.663290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 87/166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:20 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:20.825314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:20.826043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:20.831861 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.832347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.832788 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.833477 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:20.833963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:20.834394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:20.961975 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:20.969375 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6f0c4569-bf84-4557-a5e4-7315e792deaa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.148646 Aug 10 10:04:20.969938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 80/167] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:20 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:21.519487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:21.520095 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:21.525936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:21.526423 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:21.528317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:21.528317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:21.528317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:21.528646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:21.533538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:21.534155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:21.540702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:21.541189 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:21.541804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:21.542567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:21.542975 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:21.543589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:21.727663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:21.734733 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:21.735837 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6ce7661c-c9bf-426e-ada2-bb02aeb32f0e tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1501 microversion: 2.1 time: 0.220133 Aug 10 10:04:21.736409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 88/168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:21 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1501 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:21.738220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:21.741765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:21.742435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:21.742648 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7f091e56-a7ff-4e9f-b82e-56676dc06667 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.212883 Aug 10 10:04:21.743397 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 81/169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:21 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:21.749575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:21.750133 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:21.750823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:21.751544 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:21.752193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:21.752447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:21.898426 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:21.907432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d1da0435-9dbd-4973-a770-7d68020b4fbb tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1555 microversion: 2.1 time: 0.169284 Aug 10 10:04:21.907998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 89/170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:21 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:21.990866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:21.991510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:21.998226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:21.998707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:21.999178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:21.999868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:22.000326 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:22.001015 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:22.128803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:22.136292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7b1bab0a-e6b1-401e-9552-f038292fe24f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.149671 Aug 10 10:04:22.136865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 82/171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:21 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:22.757603 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:22.758288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:22.763856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:22.764505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:22.765107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:22.765597 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:22.766039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:22.766718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:22.767244 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:22.767667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:22.770701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:22.771228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:22.771667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:22.772358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:22.772816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:22.773243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:22.960752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:22.964276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:22.972833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b14a788c-2ff9-4bb3-909c-31f03216780d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.213300 Aug 10 10:04:22.973529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 83/172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:22 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:22.974787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-060f8f81-24d8-4c26-93a7-100697890c65 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1501 microversion: 2.1 time: 0.220833 Aug 10 10:04:22.986618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 90/173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:22 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:22.986774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:22.986774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:22.990023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:22.990512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:22.990970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:22.991703 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:22.992163 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:22.992598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:23.117714 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:23.125841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-138c0de2-6e4c-4995-986a-34f4cda008e1 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1555 microversion: 2.1 time: 0.150877 Aug 10 10:04:23.126410 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 84/174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:22 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:23.158005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:23.158614 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:23.164481 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:23.164965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:23.165405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:23.166129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:23.166585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:23.167041 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:23.293834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:23.301152 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-da499876-247e-4e36-97cf-7e66679a4b76 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.146952 Aug 10 10:04:23.301723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 91/175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:23 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:23.996477 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:23.997351 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:23.999051 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:24.001222 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:24.008773 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.010531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.012484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.012725 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.013195 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.013843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.014182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.014522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.015085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.015666 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.017915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.019250 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.314242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:24.322019 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:24.330218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fb422ed0-8669-412f-9afb-501ac356d9c2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.339677 Aug 10 10:04:24.331137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 85/176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:23 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:24.336166 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:24.336777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:24.344028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.344560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.345007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.345715 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.346177 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.346773 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.349238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-803e5448-a96c-4743-8366-43c5d122210b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1501 microversion: 2.1 time: 0.355771 Aug 10 10:04:24.350251 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 92/177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:23 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1501 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:24.372156 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:24.372786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:24.403186 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.403693 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.408922 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.410140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:24.410632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:24.411122 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:24.707343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:24.712154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:24.717893 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7da0bea9-8652-4ae0-a855-0724d13c31f3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.366601 Aug 10 10:04:24.719412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 93/178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:24 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:24.731068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-307ef589-b62e-4abd-b061-c753f015d967 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1555 microversion: 2.1 time: 0.398126 Aug 10 10:04:24.744648 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 86/179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:24 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1555 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:25.175931 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-a8d4ecbc-33e2-4972-aecd-a2dadc34fe74 req-db8feba7-7f2e-4d42-a95b-513e0809a613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599abfa0-b16b-45c9-bf6a-f2798f1f49ee", "name": "network-vif-deleted", "tag": "ca8310e3-db1e-4840-90a0-bef8820f4a41"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:25.182552 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-353d22c6-7d7a-483a-a06f-596e34988804 req-d9ec46ae-a23a-4bc1-86c8-d2e08b8bcbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ee68991-bff4-4467-81c2-33a89fe97827", "name": "network-vif-deleted", "tag": "0f8528cb-a4cb-45a5-bc66-313c4fcfb795"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:25.193397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-a8d4ecbc-33e2-4972-aecd-a2dadc34fe74 req-db8feba7-7f2e-4d42-a95b-513e0809a613 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.194118 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-a8d4ecbc-33e2-4972-aecd-a2dadc34fe74 req-db8feba7-7f2e-4d42-a95b-513e0809a613 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.195373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-a8d4ecbc-33e2-4972-aecd-a2dadc34fe74 req-db8feba7-7f2e-4d42-a95b-513e0809a613 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.208292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-353d22c6-7d7a-483a-a06f-596e34988804 req-d9ec46ae-a23a-4bc1-86c8-d2e08b8bcbae service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.209440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-353d22c6-7d7a-483a-a06f-596e34988804 req-d9ec46ae-a23a-4bc1-86c8-d2e08b8bcbae service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.210889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-353d22c6-7d7a-483a-a06f-596e34988804 req-d9ec46ae-a23a-4bc1-86c8-d2e08b8bcbae service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.232008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-a8d4ecbc-33e2-4972-aecd-a2dadc34fe74 req-db8feba7-7f2e-4d42-a95b-513e0809a613 service nova] Creating event network-vif-deleted:ca8310e3-db1e-4840-90a0-bef8820f4a41 for instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee on hv-cinder-85083 Aug 10 10:04:25.236406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-353d22c6-7d7a-483a-a06f-596e34988804 req-d9ec46ae-a23a-4bc1-86c8-d2e08b8bcbae service nova] Creating event network-vif-deleted:0f8528cb-a4cb-45a5-bc66-313c4fcfb795 for instance 1ee68991-bff4-4467-81c2-33a89fe97827 on hv-cinder-85083 Aug 10 10:04:25.239591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-a8d4ecbc-33e2-4972-aecd-a2dadc34fe74 req-db8feba7-7f2e-4d42-a95b-513e0809a613 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070045 Aug 10 10:04:25.241227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 94/180] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:25.255595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-353d22c6-7d7a-483a-a06f-596e34988804 req-d9ec46ae-a23a-4bc1-86c8-d2e08b8bcbae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077637 Aug 10 10:04:25.257047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 87/181] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:25.354332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:25.355406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:25.376302 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:25.377069 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:25.383419 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.383603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.384043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.384449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.384576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.385153 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.385287 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.385624 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.386054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.386457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.387123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.387696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.479559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:25.491096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-76990d28-870a-4a11-8f7d-df446249a7fa tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 200 len: 1459 microversion: 2.1 time: 0.120842 Aug 10 10:04:25.492113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:25 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 1459 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:25.633566 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:25.643265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-da644975-995e-461e-8e00-6e18a4e22825 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.293621 Aug 10 10:04:25.643858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 95/183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:25 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:25.740145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:25.740812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:25.753177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:25.753785 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:25.763217 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.763745 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.764325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.764829 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.765334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.765451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.766860 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.767328 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.767768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.767974 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:25.772390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:25.774382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:25.858604 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d53857c736c4a75abe0d4979517bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229ece368fc1458ba1c6cd94cb28f87a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:25.868662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1991e232-1d83-414f-849f-675f6e170bbe tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 200 len: 1346 microversion: 2.1 time: 0.119486 Aug 10 10:04:25.869577 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 96/184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:25 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:26.013352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:26.021119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4df94648-2922-430d-8d55-17a8220639c7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.284905 Aug 10 10:04:26.021921 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 89/185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:25 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:26.517259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:26.517833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 1ee68991-bff4-4467-81c2-33a89fe97827] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:26.523652 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:26.524351 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:26.524936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:26.525790 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:26.526400 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:26.526994 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:26.550870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] HTTP exception thrown: Instance 1ee68991-bff4-4467-81c2-33a89fe97827 could not be found. Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Request method failure captured: Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 HTTP/1.1 Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84KLT1nyKnp3swpslnSV-Fw58dLpuQ4qFHr_-9zeRsS83rxlApQcQ2Bbfyi1G6S4WBK2ZI1XjQTS8OQzvj0oyWllA1-HS4c3HC68QDxQmlbbZCoF_FAlUcjEvC_LGfTKn0rWSBW8KTdXSd0VxAbZGp9MwgIHc0-TCHC0e5iqowoAstI Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 76f7f3766f4a44c4b3859b8199a670da Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesActionsTest-729169636 Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:04:26.556932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/76f7f3766f4a44c4b3859b8199a670da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76f7f3766f4a44c4b3859b8199a670da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_76f7f3766f4a44c4b3859b8199a670da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76f7f3766f4a44c4b3859b8199a670da"}]}] Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesActionsTest-729169636 Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 76f7f3766f4a44c4b3859b8199a670da Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesActionsTest-729169636 Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesActionsTest-729169636-project Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 7ecb55aabbe64be7907123772c359287 Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesActionsTest-729169636-project Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 1ee68991-bff4-4467-81c2-33a89fe97827 could not be found. Aug 10 10:04:26.558227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '1ee68991-bff4-4467-81c2-33a89fe97827'} Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ee68991-bff4-4467-81c2-33a89fe97827 could not be found. Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:04:26.559598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ee68991-bff4-4467-81c2-33a89fe97827 could not be found. Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ee68991-bff4-4467-81c2-33a89fe97827 could not be found. Aug 10 10:04:26.561515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:26.566780 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Returning 404 to user: Instance 1ee68991-bff4-4467-81c2-33a89fe97827 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:04:26.568123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-463b58ef-0e4e-45c6-a447-1470d3936d0b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827" status: 404 len: 111 microversion: 2.1 time: 0.057070 Aug 10 10:04:26.572889 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 97/186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:26 2022] GET /compute/v2.1/servers/1ee68991-bff4-4467-81c2-33a89fe97827 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:04:26.668601 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:26.669839 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:26.678864 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:26.679677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:26.680602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:26.681540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:26.682193 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:26.682830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:26.733157 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-810813326", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "networks": [{"uuid": "49a83621-8ac5-43fa-b021-296a2b74428f"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:26.839351 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] validate_networks() for [('49a83621-8ac5-43fa-b021-296a2b74428f', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:04:27.009639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:27.020672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c1ad0247-daa5-4a30-a483-d91de5625a77 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.356038 Aug 10 10:04:27.024032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 90/187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:26 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:27.044145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:27.044962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:27.053283 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.056001 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.056874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.058766 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.060083 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.061281 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.079423 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] HTTP exception thrown: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Request method failure captured: Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee HTTP/1.1 Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JcSLv1441iAJ0KnL0Z8fybVQBWSeZO8PAUy1W4olDO0JzSOPxb7XveJCKXEUCfQuDLe8plAeETJkVKCNoN2__g5tBhFfrf1xwwoebkGbwPKiIZY2y3RaYQ6hv0FcdCCRoc5gB2dFfguAn0wL9plKTjh6r49QPW-ML_deWuhzzU5JA Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:04:27.084122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}] Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 0d53857c736c4a75abe0d4979517bc58 Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.085443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '599abfa0-b16b-45c9-bf6a-f2798f1f49ee'} Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:04:27.086241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.087667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.088751 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Returning 404 to user: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:04:27.088751 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3f9a3819-5082-45f3-be8f-bf1177f27caa tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 404 len: 111 microversion: 2.1 time: 0.046686 Aug 10 10:04:27.088751 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 91/188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:27 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:04:27.097332 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:27.097896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:27.104830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.105582 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.106328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.107263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.107868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.108452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.487424 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:27.496003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ad86d485-b527-4890-b9ae-089a17a3f225 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.404505 Aug 10 10:04:27.507388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 92/189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:27 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:27.517641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:27.520181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:27.526813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.527489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.528038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.528864 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.529538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.530110 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.544188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] HTTP exception thrown: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Request method failure captured: Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee/os-volume_attachments HTTP/1.1 Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JcSLv1441iAJ0KnL0Z8fybVQBWSeZO8PAUy1W4olDO0JzSOPxb7XveJCKXEUCfQuDLe8plAeETJkVKCNoN2__g5tBhFfrf1xwwoebkGbwPKiIZY2y3RaYQ6hv0FcdCCRoc5gB2dFfguAn0wL9plKTjh6r49QPW-ML_deWuhzzU5JA Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:04:27.546111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}] Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 0d53857c736c4a75abe0d4979517bc58 Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.547592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'server_id': '599abfa0-b16b-45c9-bf6a-f2798f1f49ee'} Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:04:27.548231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:27.549430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:04:27.551605 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Returning 404 to user: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:04:27.552676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f6c8d042-7a69-47bc-9c19-22918907e9d5 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043809 Aug 10 10:04:27.553261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 93/190] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:04:27 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:04:27.739694 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:04:27.740120 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:04:27.740596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:04:27.741008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:04:27.741416 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:04:27.750998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.751487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.751929 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.752661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:27.753116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:27.753542 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:27.770070 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Getting quotas for project 76f7f3766f4a44c4b3859b8199a670da. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:04:27.773994 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Getting quotas for user 7ecb55aabbe64be7907123772c359287 and project 76f7f3766f4a44c4b3859b8199a670da. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:04:27.784889 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:04:27.787209 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:04:27.845528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b0bf7be8-b354-461c-9cc9-c67aa8b20f7c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108345 Aug 10 10:04:27.846174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 98/191] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:04:27.859370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-97e9b75f-b685-494e-93fd-eddb1bab7f6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:27.860567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-97e9b75f-b685-494e-93fd-eddb1bab7f6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:27.932451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-97e9b75f-b685-494e-93fd-eddb1bab7f6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:27.941947 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-97e9b75f-b685-494e-93fd-eddb1bab7f6c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1213 microversion: 2.1 time: 0.087926 Aug 10 10:04:27.942529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 94/192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:27 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:28.046047 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:28.046921 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:28.054622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.055314 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.056055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.058473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.059114 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.059734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.287935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:28.296701 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-89862760-54b1-4200-a440-0adfc10674b2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.255503 Aug 10 10:04:28.304921 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 99/193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:28 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:28.523053 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:28.523672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:28.536726 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.538356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.541633 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.543080 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.544036 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.544839 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.799363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:28.800013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:28.810336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.814687 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.819057 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.820845 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.821714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.822903 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.851209 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] HTTP exception thrown: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Request method failure captured: Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee HTTP/1.1 Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84JcSLv1441iAJ0KnL0Z8fybVQBWSeZO8PAUy1W4olDO0JzSOPxb7XveJCKXEUCfQuDLe8plAeETJkVKCNoN2__g5tBhFfrf1xwwoebkGbwPKiIZY2y3RaYQ6hv0FcdCCRoc5gB2dFfguAn0wL9plKTjh6r49QPW-ML_deWuhzzU5JA Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:04:28.853000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}] Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 0d53857c736c4a75abe0d4979517bc58 Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.854373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '599abfa0-b16b-45c9-bf6a-f2798f1f49ee'} Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:04:28.855076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.856571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.857861 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Returning 404 to user: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:04:28.859962 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07882703-ef4e-4e6c-b526-2159a6ad1351 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "DELETE /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 404 len: 111 microversion: 2.1 time: 0.064824 Aug 10 10:04:28.861069 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 100/194] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:04:28 2022] DELETE /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 10:04:28.870075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:28.870612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] [instance: 599abfa0-b16b-45c9-bf6a-f2798f1f49ee] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:28.880882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.881547 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.882000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.882786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.883308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.883956 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.910143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] HTTP exception thrown: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Request method failure captured: Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee HTTP/1.1 Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84JcSLv1441iAJ0KnL0Z8fybVQBWSeZO8PAUy1W4olDO0JzSOPxb7XveJCKXEUCfQuDLe8plAeETJkVKCNoN2__g5tBhFfrf1xwwoebkGbwPKiIZY2y3RaYQ6hv0FcdCCRoc5gB2dFfguAn0wL9plKTjh6r49QPW-ML_deWuhzzU5JA Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:04:28.912516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_229ece368fc1458ba1c6cd94cb28f87a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/229ece368fc1458ba1c6cd94cb28f87a"}]}] Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 229ece368fc1458ba1c6cd94cb28f87a Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-DeleteServersTestJSON-174787934 Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 0d53857c736c4a75abe0d4979517bc58 Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-DeleteServersTestJSON-174787934-project Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.913883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '599abfa0-b16b-45c9-bf6a-f2798f1f49ee'} Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:04:28.915627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. Aug 10 10:04:28.916683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:28.924194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] Returning 404 to user: Instance 599abfa0-b16b-45c9-bf6a-f2798f1f49ee could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:04:28.925977 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-44c0b1e4-f45a-4cf3-b4d3-944d50b5bc22 tempest-DeleteServersTestJSON-174787934 tempest-DeleteServersTestJSON-174787934-project] 10.222.0.20 "GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee" status: 404 len: 111 microversion: 2.1 time: 0.059877 Aug 10 10:04:28.930535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 101/195] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:28 2022] GET /compute/v2.1/servers/599abfa0-b16b-45c9-bf6a-f2798f1f49ee => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:04:28.964172 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:28.966563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:28.989365 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.990141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.992607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:28.995050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:28.995752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:28.996930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:29.014320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:29.022128 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-56030134-c1c6-43cb-ae4c-792d1cd28320 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.502999 Aug 10 10:04:29.024273 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 95/196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:28 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:29.118037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:29.129652 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-149bc5d8-10b0-48ee-b690-f3f42c70c4cc tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1265 microversion: 2.1 time: 0.169048 Aug 10 10:04:29.146768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 102/197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:28 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:29.318218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:29.319268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:29.336305 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:29.337503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:29.338094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:29.340612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:29.341305 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:29.341746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:29.505439 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:29.513529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c2d1c4cd-835a-4ff9-8d29-63d30f71a32a tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.199154 Aug 10 10:04:29.514089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 96/198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:29 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:30.048402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:30.049210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:30.060533 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:30.061211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:30.062111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:30.062928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:30.063516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:30.064080 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:30.156779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:30.159085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:30.166405 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:30.167197 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:30.168547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:30.175985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:30.176756 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:30.177604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:30.306199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:30.310355 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:30.315856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-efeae0d5-5627-4e10-a6d4-900f1b4ad52a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.273261 Aug 10 10:04:30.330484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 103/199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:30 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:30.343504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:30.359148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b2b76126-1018-430c-9ba8-6c3ef6f1b936 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1271 microversion: 2.1 time: 0.209067 Aug 10 10:04:30.361726 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 97/200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:30 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:30.534971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:30.535598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:30.545999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:30.547669 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:30.549612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:30.550520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:30.552417 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:30.552863 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:30.600006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-cfd8f4ed-705c-4e73-bd4a-04161fd5736d req-67f6bf4f-d936-4de2-830d-f8d27c7076e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8051dcee-4ed6-4b3d-87de-bc26e85c971e", "name": "network-vif-plugged", "status": "completed", "tag": "a3850c28-4943-4aa2-94d2-3dc9fe679ef9"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:30.615740 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-cfd8f4ed-705c-4e73-bd4a-04161fd5736d req-67f6bf4f-d936-4de2-830d-f8d27c7076e6 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:30.627377 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-cfd8f4ed-705c-4e73-bd4a-04161fd5736d req-67f6bf4f-d936-4de2-830d-f8d27c7076e6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:30.629169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-cfd8f4ed-705c-4e73-bd4a-04161fd5736d req-67f6bf4f-d936-4de2-830d-f8d27c7076e6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:30.663681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-cfd8f4ed-705c-4e73-bd4a-04161fd5736d req-67f6bf4f-d936-4de2-830d-f8d27c7076e6 service nova] Creating event network-vif-plugged:a3850c28-4943-4aa2-94d2-3dc9fe679ef9 for instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e on hv-cinder-85083 Aug 10 10:04:30.672257 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-cfd8f4ed-705c-4e73-bd4a-04161fd5736d req-67f6bf4f-d936-4de2-830d-f8d27c7076e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075487 Aug 10 10:04:30.673428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 98/201] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:30.768394 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:30.776851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-33c495a6-91c2-4e1a-9776-1e8ccf1c4a0f tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.246418 Aug 10 10:04:30.777786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 104/202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:30 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:31.338930 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:31.340474 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:31.351579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:31.352328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:31.353012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:31.353841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:31.354379 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:31.355077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:31.382069 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:31.382683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:31.389146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:31.389881 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:31.390529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:31.391469 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:31.392103 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:31.392707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:31.484510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:31.492142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-83a6e35a-207f-458f-99a4-1176d88af7b1 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1271 microversion: 2.1 time: 0.113932 Aug 10 10:04:31.492999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 105/203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:31 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:31.573744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:31.582348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c42f957c-626a-4752-9249-9a046c8a60d5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.249026 Aug 10 10:04:31.587271 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 99/204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:31 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:31.800937 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:31.802160 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:31.810836 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:31.811781 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:31.812434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:31.813620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:31.814309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:31.815257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:32.112131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:32.123896 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cf7e0bed-60b8-454f-8c0d-aa520cec9246 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1319 microversion: 2.1 time: 0.327830 Aug 10 10:04:32.128747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 106/205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:31 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:32.519450 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:32.521806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:32.534242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:32.537361 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:32.538097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:32.539099 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:32.543690 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:32.544551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:32.604163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:32.604940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:32.616114 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:32.619516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:32.619976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:32.620714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:32.622486 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:32.622928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:32.959345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:32.975591 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-58194c15-028a-4abd-80f5-e1a40aa32c96 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1313 microversion: 2.1 time: 0.463867 Aug 10 10:04:32.988594 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 100/206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:32 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:33.003988 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:33.030775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3f44c0ec-85bd-40cf-9e8c-49b025984dcb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.431219 Aug 10 10:04:33.047264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 107/207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:32 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:33.150489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:33.151204 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:33.160150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:33.160655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:33.161107 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:33.161816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:33.162281 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:33.162713 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:33.543176 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:33.577840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8c39e629-c9ec-44d9-a009-f94f99bcaa98 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1507 microversion: 2.1 time: 0.414030 Aug 10 10:04:33.593016 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 101/208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:33 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:33.883940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-b30d1173-823d-456d-a74e-ab72c2d36ec1 req-74fab6e2-5bb8-4a7a-a3c3-ac814aadf02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c0fc93-256f-4fe2-b289-41783a57d6cf", "tag": "27a59a16-69aa-4b2b-9946-935ae70955d2"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:33.899629 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:33.925696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b30d1173-823d-456d-a74e-ab72c2d36ec1 req-74fab6e2-5bb8-4a7a-a3c3-ac814aadf02d service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:33.927096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b30d1173-823d-456d-a74e-ab72c2d36ec1 req-74fab6e2-5bb8-4a7a-a3c3-ac814aadf02d service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:33.927689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b30d1173-823d-456d-a74e-ab72c2d36ec1 req-74fab6e2-5bb8-4a7a-a3c3-ac814aadf02d service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:33.987789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-b30d1173-823d-456d-a74e-ab72c2d36ec1 req-74fab6e2-5bb8-4a7a-a3c3-ac814aadf02d service nova] Creating event network-changed:27a59a16-69aa-4b2b-9946-935ae70955d2 for instance 63c0fc93-256f-4fe2-b289-41783a57d6cf on hv-cinder-85083 Aug 10 10:04:34.001779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:34.002404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:34.013743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-b30d1173-823d-456d-a74e-ab72c2d36ec1 req-74fab6e2-5bb8-4a7a-a3c3-ac814aadf02d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133755 Aug 10 10:04:34.018987 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 108/209] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:34.019590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:34.034370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:34.035054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:34.037302 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:34.044815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:34.046106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:34.055565 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:34.058618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:34.081189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:34.081906 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:34.082696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:34.084315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:34.085647 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:34.087071 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:34.118530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:34.715806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:34.724866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-aeb52cc4-c30b-4f2f-bf6a-0fea91ede81d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1313 microversion: 2.1 time: 0.728281 Aug 10 10:04:34.725460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 102/210] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:33 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:34.854338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:34.881313 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b69c27fd-82e9-4e0f-a48c-e5b929904c55 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.830832 Aug 10 10:04:34.882596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 109/211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:34 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:35.747065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:35.748357 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:35.758448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:35.758942 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:35.765959 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:35.766698 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:35.767375 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:35.767949 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:35.904462 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:35.905385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:35.928946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:35.930923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:35.932490 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:35.935457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:35.936811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:35.939038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:36.423005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:36.434766 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f9e6a271-21fc-4ac1-856f-2ea4506f414f tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1313 microversion: 2.1 time: 0.692107 Aug 10 10:04:36.435389 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 103/212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:35 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:36.639766 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:36.653187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3820c1a5-54a1-4dc6-bc15-aa5f3446772b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.752958 Aug 10 10:04:36.655905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 110/213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:35 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:37.456055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:37.456939 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:37.474798 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:37.475346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:37.475795 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:37.476526 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:37.476988 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:37.482871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:37.674856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:37.675660 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:37.690358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:37.692242 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:37.693539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:37.694518 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:37.697596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:37.698277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:37.784631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:37.784631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:37.938351 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:38.143721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:38.158045 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9342bde5-48a9-4ff9-8ae7-ef9184037262 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1313 microversion: 2.1 time: 0.704438 Aug 10 10:04:38.160304 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 104/214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:37 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1313 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:38.599728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:38.608220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-92f7b584-8ab1-4997-bf66-cb5ab880b52e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.938210 Aug 10 10:04:38.609918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 111/215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:37 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:39.180141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:39.181181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:39.192417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:39.193912 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:39.194391 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:39.194832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:39.195584 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:39.196048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:39.196478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:39.538875 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:39.547942 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-269bf6a1-7aaa-402a-a76d-f06c2cc653ea tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1313 microversion: 2.1 time: 0.371584 Aug 10 10:04:39.569353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 105/216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:39 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:39.632693 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:39.633606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:39.644039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:39.645330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:39.649980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:39.651222 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:39.651947 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:39.652683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:39.968690 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:39.994143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f70a637d-9edd-46b4-aa76-6aeb9b09962c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.361503 Aug 10 10:04:39.994866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 112/217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:39 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:40.575273 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:40.576288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:40.603206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:40.603684 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:40.604395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:40.606376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:40.607025 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:40.615450 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:40.857593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:40.881712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a9432241-1513-45aa-abbe-221370897020 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1313 microversion: 2.1 time: 0.310624 Aug 10 10:04:40.883623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 106/218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:40 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:41.018443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:41.019204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:41.036549 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:41.037058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:41.037497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:41.038220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:41.038675 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:41.039132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:41.112716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-edd2c605-da80-4cbb-b938-eedf15652ed3 req-353cd3d5-70a6-4a56-b3ae-6e53331ab7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c0fc93-256f-4fe2-b289-41783a57d6cf", "name": "network-vif-plugged", "status": "completed", "tag": "27a59a16-69aa-4b2b-9946-935ae70955d2"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:41.130893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-edd2c605-da80-4cbb-b938-eedf15652ed3 req-353cd3d5-70a6-4a56-b3ae-6e53331ab7ad service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:41.131981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-edd2c605-da80-4cbb-b938-eedf15652ed3 req-353cd3d5-70a6-4a56-b3ae-6e53331ab7ad service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:41.136886 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-edd2c605-da80-4cbb-b938-eedf15652ed3 req-353cd3d5-70a6-4a56-b3ae-6e53331ab7ad service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:41.155569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-edd2c605-da80-4cbb-b938-eedf15652ed3 req-353cd3d5-70a6-4a56-b3ae-6e53331ab7ad service nova] Creating event network-vif-plugged:27a59a16-69aa-4b2b-9946-935ae70955d2 for instance 63c0fc93-256f-4fe2-b289-41783a57d6cf on hv-cinder-85083 Aug 10 10:04:41.161636 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-edd2c605-da80-4cbb-b938-eedf15652ed3 req-353cd3d5-70a6-4a56-b3ae-6e53331ab7ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052926 Aug 10 10:04:41.162493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 107/219] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:04:41.449634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:41.463016 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-da429724-b09b-45e1-9e60-d80d9063535a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.447892 Aug 10 10:04:41.476245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 113/220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:41 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:41.909215 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:41.909917 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:41.920150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:41.920649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:41.921093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:41.921793 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:41.922265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:41.922674 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:42.273228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:42.282280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-08897c98-7dcb-42cd-acc3-7af83022197d tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1313 microversion: 2.1 time: 0.377804 Aug 10 10:04:42.285161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 108/221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:41 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:42.496199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:42.497497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:42.504042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:42.504848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:42.505506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:42.506455 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:42.507198 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:42.507838 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:43.166581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:43.174586 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-67f23ebb-5747-4b46-a0ba-00a0f4cfdf41 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.682769 Aug 10 10:04:43.182411 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 114/222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:42 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:43.306534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:43.307432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:43.327742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:43.328427 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:43.328886 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:43.332432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:43.332926 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:43.333549 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:43.608498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:43.620391 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-aa544c5d-2e41-445d-9295-17a71ea9363c tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1495 microversion: 2.1 time: 0.317818 Aug 10 10:04:43.621028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 109/223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:43 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1495 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:44.204301 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:44.205424 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:44.221720 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:44.222523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:44.223196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:44.228656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:44.229440 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:44.231249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:44.473017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:44.474432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:44.482731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:44.483603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:44.484259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:44.485162 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:44.485868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:44.486512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:44.512593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:44.523861 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6a6f842f-7c64-4031-80eb-c9f8b56987dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.323763 Aug 10 10:04:44.524448 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 115/224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:44 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:44.529090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:04:44.630772 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6a2b94ee-8012-4e8f-b558-7cded82d5a1b tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 204 len: 0 microversion: 2.1 time: 0.162473 Aug 10 10:04:44.635598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 110/225] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:04:44 2022] DELETE /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:04:44.643439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:44.644147 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:44.655769 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:44.656882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:44.657550 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:44.658445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:44.659245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:44.660423 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:44.924962 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:44.944884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a090a8db-f553-47ea-b886-3a6a02036185 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1501 microversion: 2.1 time: 0.307135 Aug 10 10:04:44.968264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 116/226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:44 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1501 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:45.546227 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:45.547808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:45.572367 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:45.572967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:45.573503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:45.575551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:45.577677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:45.579980 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:45.947081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:45.974227 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-275f13a8-7f20-49d8-972e-930d82224367 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.431494 Aug 10 10:04:45.979114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 111/227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:45 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:45.990412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:45.991266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:45.998699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:46.000008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:46.010161 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:46.054653 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:46.055340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:46.055662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:46.449245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:46.464188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-879271d7-feaa-4e0f-af0c-ba9376155c49 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1501 microversion: 2.1 time: 0.479029 Aug 10 10:04:46.464838 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 117/228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:45 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1501 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:47.012965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:47.013593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:47.028664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:47.029498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:47.031358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:47.032318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:47.033828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:47.035883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:47.485341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:47.486707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:47.502363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:47.503580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:47.504131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:47.504940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:47.505516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:47.506171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:47.869836 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:47.882761 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-64cf4dbb-71b5-4207-b0a0-47dacee6bef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1520 microversion: 2.1 time: 0.887692 Aug 10 10:04:47.889590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 112/229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:46 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1520 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:47.987211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:47.995470 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-69a5815a-510a-47bb-aca4-1679d7305226 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1501 microversion: 2.1 time: 0.513927 Aug 10 10:04:48.000056 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 118/230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:47 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1501 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:48.599108 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-7af3acfd-ab55-47fc-a27b-406d289c1415 req-08835fe6-d7a6-4cdd-bc6c-16e5ce5b75aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c0fc93-256f-4fe2-b289-41783a57d6cf", "name": "network-vif-deleted", "tag": "27a59a16-69aa-4b2b-9946-935ae70955d2"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:48.640987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-7af3acfd-ab55-47fc-a27b-406d289c1415 req-08835fe6-d7a6-4cdd-bc6c-16e5ce5b75aa service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:48.641474 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-7af3acfd-ab55-47fc-a27b-406d289c1415 req-08835fe6-d7a6-4cdd-bc6c-16e5ce5b75aa service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:48.641907 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-7af3acfd-ab55-47fc-a27b-406d289c1415 req-08835fe6-d7a6-4cdd-bc6c-16e5ce5b75aa service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:48.676493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-7af3acfd-ab55-47fc-a27b-406d289c1415 req-08835fe6-d7a6-4cdd-bc6c-16e5ce5b75aa service nova] Creating event network-vif-deleted:27a59a16-69aa-4b2b-9946-935ae70955d2 for instance 63c0fc93-256f-4fe2-b289-41783a57d6cf on hv-cinder-85083 Aug 10 10:04:48.684642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-7af3acfd-ab55-47fc-a27b-406d289c1415 req-08835fe6-d7a6-4cdd-bc6c-16e5ce5b75aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090581 Aug 10 10:04:48.685876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 113/231] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:48.918667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:48.920142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:48.933765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:48.934174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:48.934622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:48.935405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:48.935878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:48.936304 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:49.017564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:49.018606 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:49.026238 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:49.032981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:49.033705 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:49.034651 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:49.035346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:49.035972 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:49.405124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ecb55aabbe64be7907123772c359287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f7f3766f4a44c4b3859b8199a670da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:49.424386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b6bee5ed-c1e9-417e-9bb6-90aa7e5da547 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 200 len: 1298 microversion: 2.1 time: 0.410902 Aug 10 10:04:49.431957 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 114/232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:49 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 1298 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:49.450418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:49.454999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:49.468576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:49.472233 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:49.472886 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:49.474038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:49.476446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:49.477122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:49.530788 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e8b5961c-3b27-43b0-8c8e-948e8f67d87f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/ips" status: 200 len: 151 microversion: 2.1 time: 0.084306 Aug 10 10:04:49.538836 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 115/233] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:04:49 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:49.684231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:49.693849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9accb1d7-7dec-4e71-98a5-ded72206684d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1500 microversion: 2.1 time: 0.788043 Aug 10 10:04:49.702192 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 119/234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:48 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1500 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:49.725731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:49.726364 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:49.749017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:49.751463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:49.752115 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:49.754774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:49.756165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:49.761084 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:50.078110 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:50.088209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e178f9b7-65c9-491f-b3d4-d438ae1b90f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1514 microversion: 2.1 time: 0.366787 Aug 10 10:04:50.089609 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 116/235] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:49 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1514 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:50.455879 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:50.457272 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] [instance: 63c0fc93-256f-4fe2-b289-41783a57d6cf] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:50.476635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:50.478710 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:50.481108 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:50.484613 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:50.485913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:50.487579 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:50.516143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] HTTP exception thrown: Instance 63c0fc93-256f-4fe2-b289-41783a57d6cf could not be found. Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Request method failure captured: Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf HTTP/1.1 Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84KLT1nyKnp3swpslnSV-Fw58dLpuQ4qFHr_-9zeRsS83rxlApQcQ2Bbfyi1G6S4WBK2ZI1XjQTS8OQzvj0oyWllA1-HS4c3HC68QDxQmlbbZCoF_FAlUcjEvC_LGfTKn0rWSBW8KTdXSd0VxAbZGp9MwgIHc0-TCHC0e5iqowoAstI Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 76f7f3766f4a44c4b3859b8199a670da Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesActionsTest-729169636 Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:04:50.519145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/76f7f3766f4a44c4b3859b8199a670da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76f7f3766f4a44c4b3859b8199a670da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_76f7f3766f4a44c4b3859b8199a670da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/76f7f3766f4a44c4b3859b8199a670da"}]}] Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesActionsTest-729169636 Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 76f7f3766f4a44c4b3859b8199a670da Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesActionsTest-729169636 Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesActionsTest-729169636-project Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 7ecb55aabbe64be7907123772c359287 Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesActionsTest-729169636-project Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 63c0fc93-256f-4fe2-b289-41783a57d6cf could not be found. Aug 10 10:04:50.520385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '63c0fc93-256f-4fe2-b289-41783a57d6cf'} Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c0fc93-256f-4fe2-b289-41783a57d6cf could not be found. Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:04:50.521086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c0fc93-256f-4fe2-b289-41783a57d6cf could not be found. Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c0fc93-256f-4fe2-b289-41783a57d6cf could not be found. Aug 10 10:04:50.522184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:04:50.526728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] Returning 404 to user: Instance 63c0fc93-256f-4fe2-b289-41783a57d6cf could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:04:50.528425 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-744aaebf-e80d-4baa-8b46-ec38fae1c5f9 tempest-VolumesActionsTest-729169636 tempest-VolumesActionsTest-729169636-project] 10.222.0.20 "GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf" status: 404 len: 111 microversion: 2.1 time: 0.079166 Aug 10 10:04:50.530184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 120/236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:50 2022] GET /compute/v2.1/servers/63c0fc93-256f-4fe2-b289-41783a57d6cf => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:04:50.736820 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d1122fe3-04fa-47a5-8242-076729cf8ee4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'create', calling method: .version_select at 0x7f2308044700>, body: {"keypair": {"name": "tempest-keypair-486393413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi/RxBLa+++V+32EJ4nwh2kxX88gK7huTCAUWXBpZK6ks7k9n1MBctXOyesQT2N0VE8DpkBWLjAa1lGQuUeUc8U5tINmSjeMkqzQGHT4wtVI32/LgLLtMBYrAdwhCDYVg=="}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:50.759033 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-d1122fe3-04fa-47a5-8242-076729cf8ee4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for project 20760466eac94b87b14c279bba223b2d. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:04:50.765620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-d1122fe3-04fa-47a5-8242-076729cf8ee4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for user 2ef546ba84fa46d581ed6c82ec302e7d and project 20760466eac94b87b14c279bba223b2d. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:04:50.806065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d1122fe3-04fa-47a5-8242-076729cf8ee4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.334862 Aug 10 10:04:50.811784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 117/237] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 10 10:04:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 10:04:51.701603 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:51.704171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:51.717529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:51.718037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:51.718480 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:51.719231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:51.723958 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:51.726435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:51.876796 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:52.560561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:52.566695 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:52.598519 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:52.599069 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:52.599507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:52.603170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:52.631040 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:52.633683 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:52.713246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lazy-loading 'flavor' on Instance uuid a7915e13-08f0-47b2-a0a9-334681c80ae6 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:04:52.790367 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-62d091dd-9f33-4c25-8c9f-d1c2b4eee566 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.093173 Aug 10 10:04:52.796488 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 121/238] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:04:51 2022] POST /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments => generated 194 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:52.808620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48768710-498b-4883-a225-9cf065d02a97", "device": "/dev/sdb"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:52.819788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:52.837408 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:52.840037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:52.840731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:52.841640 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:52.844151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:52.845212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:53.051406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:53.082190 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-85164d71-5d2e-4b1c-a934-f46e1ddca89a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6/action" status: 200 len: 32 microversion: 2.1 time: 0.549776 Aug 10 10:04:53.094071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 118/239] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:04:52 2022] POST /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6/action => generated 32 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:04:53.104160 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:53.112082 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:53.135631 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:53.137152 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:53.137665 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:53.138396 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:53.138879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:53.139334 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:53.423567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:53.434853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c1d682df-3f47-4440-a86e-699e4125ce9b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.335117 Aug 10 10:04:53.439993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 119/240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:53 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:04:53.812464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1321382357", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c3db249-1a90-4663-b802-a2e70c9ff42b"}], "security_groups": [{"name": "tempest-securitygroup--1465965980"}], "key_name": "tempest-keypair-486393413", "user_data": "}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:04:53.969273 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.network.neutron [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] validate_networks() for [('1c3db249-1a90-4663-b802-a2e70c9ff42b', None, None, None, None, None)] {{(pid=117895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:04:54.671779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Flavor limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:04:54.672402 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Image limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:04:54.679511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Flavor pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:04:54.680226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Image pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:04:54.681155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:04:54.700926 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:54.707865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:54.708319 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:54.709132 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:54.709592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:54.710017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:54.737914 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for project 20760466eac94b87b14c279bba223b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:04:54.744467 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for user 2ef546ba84fa46d581ed6c82ec302e7d and project 20760466eac94b87b14c279bba223b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:04:54.757236 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Going to run 1 instances... {{(pid=117895) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:04:54.759792 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:04:54.834214 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-55ab9d14-c2e7-4ae3-8efc-762d4d3cef8a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.026165 Aug 10 10:04:54.837757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 120/241] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 10 10:04:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 10 10:04:54.850088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:54.850693 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:54.878891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:54.879422 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:54.879870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:54.880579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:54.881027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:54.881468 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:55.135175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:55.147135 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-01b0728d-f8b8-4476-862b-3dc90964ec51 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.305507 Aug 10 10:04:55.147826 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 121/242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:54 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:55.156878 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4fdef581-7590-4fbd-8840-d33003391747 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:55.157869 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4fdef581-7590-4fbd-8840-d33003391747 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:55.286604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4fdef581-7590-4fbd-8840-d33003391747 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:55.302842 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4fdef581-7590-4fbd-8840-d33003391747 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:55.314076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4fdef581-7590-4fbd-8840-d33003391747 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:55.317933 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4fdef581-7590-4fbd-8840-d33003391747 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1281 microversion: 2.20 time: 0.166652 Aug 10 10:04:55.319015 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 122/243] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:04:55 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1281 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:04:55.488713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-62f0410c-caac-4386-844b-21c52e2215cb tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "POST /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.687967 Aug 10 10:04:55.496600 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 122/244] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:04:52 2022] POST /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e/os-volume_attachments => generated 194 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:04:56.174028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:56.175660 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:56.183678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:56.184734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:56.187356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:56.188409 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:56.188902 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:56.189823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:56.348611 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:56.349327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:56.369674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:56.370203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:56.378327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:56.381147 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:56.383154 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:56.383541 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:56.641598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:56.658340 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-86d9409e-98a3-44c2-973d-046d94805f8f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.489031 Aug 10 10:04:56.658974 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 123/245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:56 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:56.676036 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:56.692292 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:56.698236 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:56.700559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d2dac617-7915-4568-a207-ae3cc6aaca1f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1333 microversion: 2.20 time: 0.357635 Aug 10 10:04:56.703638 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 123/246] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:04:56 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1333 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:04:57.682092 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:57.682713 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:57.703218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:57.706309 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:57.706803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:57.707589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:57.708082 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:57.711857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:57.728992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:57.730905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:57.742312 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:57.743115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:57.744471 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:57.746842 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:57.747505 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:57.748595 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:57.915902 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:57.929694 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:57.935532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:57.936755 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b3861dd7-772a-48e8-b0e6-f5064a29b8ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1339 microversion: 2.20 time: 0.213655 Aug 10 10:04:57.950980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 124/247] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:04:57 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:04:58.840325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:58.871377 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a1a5234b-ed48-4827-becf-f82e81f5b3ba tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 1.194492 Aug 10 10:04:58.876416 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 124/248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:57 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:04:58.966851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:58.967539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:58.976821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:58.982684 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:58.986087 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:58.986841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:58.988247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:58.988697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:59.561225 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:59.582109 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:59.584191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:04:59.587500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c683caca-8108-4dde-917d-a3dc9b230f9a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.625357 Aug 10 10:04:59.603828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 125/249] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:04:58 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:04:59.901558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:04:59.902687 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:04:59.916709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:59.918831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:59.919499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:04:59.921274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:04:59.923395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:04:59.924848 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:00.536055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:00.546188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4228a903-c050-44fa-bc36-3ff28c942664 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.651643 Aug 10 10:05:00.563495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 125/250] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:04:59 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:00.620106 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:00.622046 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:00.637478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:00.637985 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:00.638431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:00.639187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:00.639645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:00.642517 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:00.901552 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-1cf883b8-e0d8-43db-a9ef-45d4042a8e4f req-b1ff224f-6507-40b9-b755-c70098853155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9", "tag": "572a9818-c1ee-4385-bd79-7c0a76329a99"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:00.926672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-1cf883b8-e0d8-43db-a9ef-45d4042a8e4f req-b1ff224f-6507-40b9-b755-c70098853155 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:00.938335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-1cf883b8-e0d8-43db-a9ef-45d4042a8e4f req-b1ff224f-6507-40b9-b755-c70098853155 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:00.939252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-1cf883b8-e0d8-43db-a9ef-45d4042a8e4f req-b1ff224f-6507-40b9-b755-c70098853155 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:00.978080 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-1cf883b8-e0d8-43db-a9ef-45d4042a8e4f req-b1ff224f-6507-40b9-b755-c70098853155 service nova] Creating event network-changed:572a9818-c1ee-4385-bd79-7c0a76329a99 for instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 on hv-cinder-85083 Aug 10 10:05:00.997514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-1cf883b8-e0d8-43db-a9ef-45d4042a8e4f req-b1ff224f-6507-40b9-b755-c70098853155 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099451 Aug 10 10:05:00.998757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 126/251] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:01.571670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:01.574842 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:01.583544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:01.584795 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:01.585569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:01.586784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:01.598352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:01.601419 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:01.622700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:01.631531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:01.637258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:01.648434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0649196e-9e29-4a94-9927-3165522d36b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 1.034540 Aug 10 10:05:01.649640 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 126/252] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:00 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:01.813641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:01.822035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-93b2b4d8-6cca-429d-8863-b2ff00d9755f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.255589 Aug 10 10:05:01.823714 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 127/253] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:01 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:02.675550 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:02.679060 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:02.689121 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:02.689873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:02.691018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:02.692194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:02.692848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:02.696046 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:02.845858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:02.847237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:02.861463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:02.865573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:02.867566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:02.868561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:02.876238 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:02.877012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:03.283331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:03.296705 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6fe4e420-7a20-4489-93bb-26d862e19392 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.454254 Aug 10 10:05:03.315210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 128/254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:02 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:03.355120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-879ab47b-1e80-4f9a-aab8-7567d7a5b6da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: .version_select at 0x7f2308326d30>, body: {"keypair": {"name": "tempest-keypair-467445688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZcEhf4BdVF8E8UgkU396sG8zGKYC+XtooYXhq9fj+/dQiaCTQLzYjA8pIEw7nJU7vhwGHnH66rNV1WmbYUa9cgAje03HwOAFOQiAPtVrmPmOOiKC6IvBFXgUiBCcVAAQ=="}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:03.394870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-879ab47b-1e80-4f9a-aab8-7567d7a5b6da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:05:03.431256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-879ab47b-1e80-4f9a-aab8-7567d7a5b6da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:05:03.460573 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:03.473399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:03.480084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:03.486152 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b612c48c-7003-4ef0-b016-450d8610aa17 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.813670 Aug 10 10:05:03.488264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 127/255] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:02 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:03.494620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-879ab47b-1e80-4f9a-aab8-7567d7a5b6da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144086 Aug 10 10:05:03.502583 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 129/256] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:05:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:05:04.185286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d50b42d2-ebe4-46d9-a9bc-6cdd0ef18d9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Action: 'create', calling method: .version_select at 0x7f2308888dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1038842877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCygoFa20A/FcFs0NTp4NN2WhoUgsZ73LDaZdTacwWzE0AHJjy1Fh3w9zO8ZCsDmnQWIPcU7cHSGeSAqn6nd6N1pfF2Tru+4aDioO5827vMiyknELveLZ+1ed4uuYkf5Eg=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:04.206225 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=40 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:04.283324 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-d50b42d2-ebe4-46d9-a9bc-6cdd0ef18d9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Getting quotas for project 281a4bf45d474217a84a31cee8128a87. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:05:04.298786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-d50b42d2-ebe4-46d9-a9bc-6cdd0ef18d9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Getting quotas for user e9b57c80a45a454680de3e69db92c6cc and project 281a4bf45d474217a84a31cee8128a87. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:05:04.322242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:04.324233 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:04.341570 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:04.342350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:04.343320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:04.344722 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:04.345523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:04.346292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:04.388310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d50b42d2-ebe4-46d9-a9bc-6cdd0ef18d9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.206863 Aug 10 10:05:04.388924 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 128/257] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:05:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:04.521919 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:04.523402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:04.544327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:04.545056 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:04.547100 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:04.548102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:04.549812 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:04.552267 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:04.724383 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:04.742068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:04.746425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-583235c8-9b4b-4cd1-95be-8423f8fba384 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.428655 Aug 10 10:05:04.761809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 130/258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:04 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:04.771740 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-187900217", "imageRef": "1264f1af-3867-4735-a7dd-e3af7a6d5f04", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1038842877", "networks": [{"uuid": "a1d9e6da-4021-43bd-8085-1ae6c9d7b8d2"}]}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:04.847471 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:04.862855 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.network.neutron [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] validate_networks() for [('a1d9e6da-4021-43bd-8085-1ae6c9d7b8d2', None, None, None, None, None)] {{(pid=117895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:05:04.878749 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:04.892586 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:04.897174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-836591c5-4a3c-470a-bbaa-2e321b6ea9ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.383009 Aug 10 10:05:04.906987 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 129/259] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:04 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:05:05.592794 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Flavor limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:05:05.593454 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Image limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:05:05.594113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Flavor pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:05:05.594862 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Image pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:05:05.595604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:05:05.602690 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:05.641126 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:05.643551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:05.650356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:05.652137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:05.652769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:05.653380 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:05.674763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Getting quotas for project 281a4bf45d474217a84a31cee8128a87. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:05:05.690331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Getting quotas for user e9b57c80a45a454680de3e69db92c6cc and project 281a4bf45d474217a84a31cee8128a87. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:05:05.721224 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Going to run 1 instances... {{(pid=117895) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:05:05.733559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1264f1af-3867-4735-a7dd-e3af7a6d5f04',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:05:05.770520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:05.771827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:05.783587 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:05.784474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:05.785473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:05.787100 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:05.787802 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:05.788434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:05.849173 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e294bc93-f033-45ff-bf35-37ed1184e01e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085875 Aug 10 10:05:05.858613 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 131/260] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:05:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:05:05.887085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9dedf423-c6f3-4f6b-be58-319a697c117f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:05.889049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9dedf423-c6f3-4f6b-be58-319a697c117f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:06.112012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9dedf423-c6f3-4f6b-be58-319a697c117f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:06.127843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9dedf423-c6f3-4f6b-be58-319a697c117f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1258 microversion: 2.1 time: 0.260525 Aug 10 10:05:06.130143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 132/261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:05 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1258 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:06.136787 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:06.137739 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:06.171319 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:06.172663 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:06.173339 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:06.174306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:06.175119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:06.175812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:06.230725 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:06.269599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2459e34d-cc29-46ee-8c8a-ada4dbebdd56 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.504524 Aug 10 10:05:06.283777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 130/262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:05 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:06.290337 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-318737715", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0883fa82-bc1b-403f-a6c6-d9e718def253"}], "security_groups": [{"name": "tempest-securitygroup--1186627689"}], "key_name": "tempest-keypair-467445688", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:06.507848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] validate_networks() for [('0883fa82-bc1b-403f-a6c6-d9e718def253', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:05:06.586840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:06.612768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:06.624405 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:06.631420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6afbd796-1cbb-472c-8055-93ebd3e31e3d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.497784 Aug 10 10:05:06.633468 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 133/263] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:06 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:07.105464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:05:07.105979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:05:07.106354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:05:07.106765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:05:07.107215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:05:07.120813 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.121349 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.121793 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:07.122532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.123038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.123439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:07.158473 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:07.158635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:05:07.159580 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:07.163287 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:05:07.176043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.178673 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.179237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:07.180210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:05:07.182119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.182795 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.183530 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:05:07.185542 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:07.273062 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-264ae376-fcf3-4dd5-a0a6-6e5052f1f114 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.986629 Aug 10 10:05:07.275098 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 131/264] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:05:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:05:07.278607 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:07.287234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-12a23f00-c0f2-45db-9ea4-9e139193125f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:07.287880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-12a23f00-c0f2-45db-9ea4-9e139193125f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:07.292723 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-af3013bc-a1a4-4e1e-aeaa-658cd4bbf84f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1310 microversion: 2.1 time: 0.138880 Aug 10 10:05:07.295812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 134/265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:07 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1310 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:07.311436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:07.312232 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:07.330985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.333691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.335170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:07.336451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.337429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.338195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:07.369308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-12a23f00-c0f2-45db-9ea4-9e139193125f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:07.379088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-12a23f00-c0f2-45db-9ea4-9e139193125f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1240 microversion: 2.1 time: 0.096234 Aug 10 10:05:07.380440 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 132/266] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:07 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:07.653506 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:07.664137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:07.665273 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:07.672548 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f33683b3-beab-45fe-b00a-f404d8a23c2c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.373645 Aug 10 10:05:07.696816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 135/267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:07 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:07.697281 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.698036 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.698756 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:07.699766 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:07.700445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:07.701107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:08.044394 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:08.054432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:08.057402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:08.060256 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-706d9811-980d-4b46-9a17-a1b1842e5f92 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.401885 Aug 10 10:05:08.077832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 133/268] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:07 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:08.317406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:08.318317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:08.328667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:08.329150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:08.329602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:08.330533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:08.331183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:08.331771 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:08.399921 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:08.404338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:08.414789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:08.415624 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:08.416254 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:08.422597 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:08.423306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:08.423938 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:08.437657 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:08.465865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-04e0695e-6074-4843-9a4a-18fb55f371b5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1316 microversion: 2.1 time: 0.153889 Aug 10 10:05:08.467719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 136/269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:08 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:08.518536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:08.527980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5abebede-6c8d-46c5-890e-28e895fe3ce6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1244 microversion: 2.1 time: 0.131800 Aug 10 10:05:08.528730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 134/270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:08 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1244 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:08.706442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:08.707485 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:08.721946 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:08.723728 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:08.724384 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:08.725326 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:08.725992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:08.726857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:09.100094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:09.103685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:09.119616 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:09.122376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:09.123084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:09.129043 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:09.129811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:09.130503 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:09.174822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:09.183453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0fb08682-879b-4c92-96f1-b99e97187a25 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.483994 Aug 10 10:05:09.188786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 137/271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:08 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:09.487263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:09.488135 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:09.511505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:09.517420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:09.518645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:09.523648 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:09.524384 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:09.528541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:09.654008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:09.701570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:09.719011 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:09.731856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ae7d6d1a-7c75-47de-9b67-848b73eeeb8b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.633203 Aug 10 10:05:09.737062 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 135/272] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:09 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:09.769363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:09.770315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:09.778038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:09.782375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:09.785257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:09.789438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:09.793538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:09.794061 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:10.169178 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:10.180317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-41990929-e66c-4f02-be86-7abd02006cc1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1310 microversion: 2.1 time: 0.441705 Aug 10 10:05:10.181259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 136/273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:09 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1310 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:10.205868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:10.206534 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:10.220428 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:10.220936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:10.221378 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:10.222097 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:10.222385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:10.222842 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:10.223054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:10.233413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fb66b1b6-aa8f-498c-8a4b-e64279ed0da2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.750502 Aug 10 10:05:10.236518 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 138/274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:09 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:10.426239 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:10.435312 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-adbc2882-d6a8-4694-816f-b5be1b557ef8 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.233275 Aug 10 10:05:10.451227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 137/275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:10 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:10.768736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:10.770052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:10.778137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:10.778894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:10.779566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:10.780431 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:10.781048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:10.781639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:10.802061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:10.925249 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:10.933541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:10.935408 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:10.936860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f9db711d-ffa3-46be-a5e6-1c9629edabd2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.180654 Aug 10 10:05:10.937632 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 139/276] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:10 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:11.202033 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:11.202671 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:11.209276 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.210031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.210716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:11.211533 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.212038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.212636 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:11.232024 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:11.259839 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:11.261681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:11.268510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.268995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.269619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:11.270512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.271029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.271441 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:11.295558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:11.304772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-99426c6b-5ad4-43d7-a3ec-cb2273698714 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1298 microversion: 2.1 time: 0.107019 Aug 10 10:05:11.319342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 138/277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:11 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:11.425823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:11.433864 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-199c1475-f06b-45f1-982e-79a366a3e922 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.180335 Aug 10 10:05:11.434433 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 140/278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:11 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:11.457862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:11.458409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:11.464864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.465734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.465841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:11.466466 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.466922 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.467570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:11.610801 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:11.620030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f2fecbb4-2aab-4d04-aa50-a0ec3ab75abf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.166277 Aug 10 10:05:11.621216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 139/279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:11 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:11.959829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:11.960864 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:11.968544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.969239 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.969850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:11.970838 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:11.971586 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:11.972166 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:12.165352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:12.174209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:12.175869 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:12.177517 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8df6f185-5a19-4945-8823-43ff5c53da7d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.221293 Aug 10 10:05:12.178602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 141/280] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:11 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:12.329913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:12.330576 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:12.337611 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:12.338445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:12.339022 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:12.339999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:12.340556 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:12.341078 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:12.418151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:12.426884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e02f835c-b447-43d2-ada4-dbcb93091a42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1298 microversion: 2.1 time: 0.104236 Aug 10 10:05:12.427714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 140/281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:12 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:12.456570 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:12.457357 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:12.464113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:12.464600 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:12.465059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:12.465832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:12.466201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:12.466615 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:12.607068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:12.616561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-42471c5f-a01c-43f1-93ca-e4007efde6dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.163747 Aug 10 10:05:12.617155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 142/282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:12 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:12.642027 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:12.642862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:12.649680 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:12.650268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:12.650913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:12.651733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:12.652208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:12.652685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:12.830661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:12.840245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b8df1a84-b6d1-4b42-8429-bd245614331f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.202217 Aug 10 10:05:12.840987 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 141/283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:12 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:13.203664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:13.204668 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:13.223256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.224047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.224683 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.225577 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.226202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.226793 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.390560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:13.415384 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:13.417622 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:13.419091 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b14828fa-e93b-45a6-9e4a-4c93b94a14f3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.220921 Aug 10 10:05:13.427769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 143/284] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:13 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:13.448721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:13.450141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:13.458805 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.466937 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.467713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.468663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.469396 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.470041 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.553617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:13.567583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b7377160-60e6-4bca-91ff-b41faa6a8f4e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1298 microversion: 2.1 time: 0.123206 Aug 10 10:05:13.568491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 142/285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:13 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:13.638630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:13.640113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:13.649132 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.650079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.650898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.651950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.652764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.653447 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.862895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:13.863456 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:13.883006 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.885814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.886381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.887353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:13.893398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:13.894232 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:13.921819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:13.941890 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b359950f-1771-430a-a9fe-0d24847a01be tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.307921 Aug 10 10:05:13.942489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 144/286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:13 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:14.341314 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:14.353674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ef6b718a-575f-40eb-914e-9fc648de26de tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.495599 Aug 10 10:05:14.355849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 143/287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:13 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:14.442882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:14.443647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:14.454803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:14.455018 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:14.465935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:14.466778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:14.468971 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:14.469438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:14.599702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:14.603257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:14.613525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:14.614332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:14.615057 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:14.615990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:14.616644 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:14.617315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:14.782485 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:14.796532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-63744569-a093-475f-9cd9-bf5111373e98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1298 microversion: 2.1 time: 0.210593 Aug 10 10:05:14.812814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 144/288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:14 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1298 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:14.885120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:14.901818 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:14.905150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:14.906412 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-565a43a3-da02-4dea-b734-694b4295b2a9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.467503 Aug 10 10:05:14.908097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 145/289] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:14 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:14.976434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:14.977681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:14.993777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:14.997802 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:14.998516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:14.999630 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.001254 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.003457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:15.367584 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:15.377414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e483a500-1444-462b-9b76-6ccd66fadb16 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.404350 Aug 10 10:05:15.378613 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 145/290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:14 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:15.378805 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:15.379679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:15.394522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.411122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.412059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:15.413337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.414514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.415325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:15.637768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-64e25a70-cce8-428a-9669-29e0f0502f1f req-2beecee4-9e35-4219-a408-eb7645eff887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3acf77a6-2970-4d9a-aee8-46e37fe3a0bb", "tag": "72577d9b-8949-4110-8e7a-5678ee2987d0"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:15.653453 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-64e25a70-cce8-428a-9669-29e0f0502f1f req-2beecee4-9e35-4219-a408-eb7645eff887 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.654225 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-64e25a70-cce8-428a-9669-29e0f0502f1f req-2beecee4-9e35-4219-a408-eb7645eff887 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.654804 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-64e25a70-cce8-428a-9669-29e0f0502f1f req-2beecee4-9e35-4219-a408-eb7645eff887 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:15.668206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:15.679624 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-64e25a70-cce8-428a-9669-29e0f0502f1f req-2beecee4-9e35-4219-a408-eb7645eff887 service nova] Creating event network-changed:72577d9b-8949-4110-8e7a-5678ee2987d0 for instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb on hv-cinder-85083 Aug 10 10:05:15.688091 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-64e25a70-cce8-428a-9669-29e0f0502f1f req-2beecee4-9e35-4219-a408-eb7645eff887 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055122 Aug 10 10:05:15.691038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 146/291] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:05:15.692444 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:15.704773 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0209490d-0d5b-4843-ae79-0cb72abd5459 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.331679 Aug 10 10:05:15.705350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 146/292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:15 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:15.821035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:15.821881 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:15.830350 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.831270 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.831932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:15.832946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.833574 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.834178 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:15.934729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:15.936295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:15.944228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.945043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.945974 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:15.946935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:15.947656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:15.948925 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:16.034536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:16.042395 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e85c85c3-5f86-4f3e-adf3-c1425ec58244 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.225814 Aug 10 10:05:16.043004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 147/293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:15 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:16.127568 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=24 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:16.144533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:16.166813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:16.168865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:16.170311 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-608a2e73-143d-4d52-b3f9-6ae12a2e465a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.243782 Aug 10 10:05:16.174257 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 147/294] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:15 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:05:16.399629 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:16.400341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:16.407632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:16.408151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:16.408625 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:16.409499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:16.409964 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:16.410392 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:16.574390 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:16.586409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-28fcc8ae-af46-4920-9872-bae98bba52b9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.190753 Aug 10 10:05:16.600920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 148/295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:16 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:16.728942 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:16.729998 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:16.737409 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:16.738413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:16.739230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:16.740314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:16.741022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:16.741659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:16.934713 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:16.943498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-227c6248-af67-4f0d-841c-35067784eee4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.220083 Aug 10 10:05:16.945079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 148/296] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:16 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:17.065665 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:17.067203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:17.081440 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.093627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.099218 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.100289 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.102215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.102857 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.159716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:17.207140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:17.207764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:17.225654 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.231597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.232343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.233290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.233762 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.234643 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.375732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=12 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:17.450840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:17.461814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-95c5657b-ebc9-463e-ad86-90736c1083c3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.400241 Aug 10 10:05:17.479349 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 149/297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:17 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:17.490431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-defeabb0-448f-4462-bcc5-d2b5c3d40637 req-8b6222fa-a7cd-43f9-8e89-78aa01f4b3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9", "name": "network-vif-plugged", "status": "completed", "tag": "572a9818-c1ee-4385-bd79-7c0a76329a99"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:17.519718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-defeabb0-448f-4462-bcc5-d2b5c3d40637 req-8b6222fa-a7cd-43f9-8e89-78aa01f4b3e8 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.520223 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-defeabb0-448f-4462-bcc5-d2b5c3d40637 req-8b6222fa-a7cd-43f9-8e89-78aa01f4b3e8 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.520627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-defeabb0-448f-4462-bcc5-d2b5c3d40637 req-8b6222fa-a7cd-43f9-8e89-78aa01f4b3e8 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.538664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-defeabb0-448f-4462-bcc5-d2b5c3d40637 req-8b6222fa-a7cd-43f9-8e89-78aa01f4b3e8 service nova] Creating event network-vif-plugged:572a9818-c1ee-4385-bd79-7c0a76329a99 for instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 on hv-cinder-85083 Aug 10 10:05:17.560005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-defeabb0-448f-4462-bcc5-d2b5c3d40637 req-8b6222fa-a7cd-43f9-8e89-78aa01f4b3e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078684 Aug 10 10:05:17.562880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 150/298] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:17.600757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:17.614565 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:17.615471 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:17.617984 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:17.620281 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:17.623981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1380ffa6-69ae-4ab3-9f52-9d46eb973bcc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.420075 Aug 10 10:05:17.625347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 149/299] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:17 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:05:17.641237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.642375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.644772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.647138 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.647887 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.648441 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.872308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:17.882182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8851feeb-6596-4462-bbc5-2c80407fae9c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.275278 Aug 10 10:05:17.883500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 151/300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:17 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:17.972410 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:17.973661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:17.981355 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.982614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.983347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:17.984273 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:17.984898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:17.985519 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:18.134855 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:18.144184 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c1d27769-a802-446e-a8ab-66dcc2525901 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.175604 Aug 10 10:05:18.155951 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 150/301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:17 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:18.486369 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:18.487321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:18.494037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:18.494638 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:18.495309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:18.496210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:18.496667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:18.497117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:18.642728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:18.653210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:18.653707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d8453b14-12da-41ea-a7ab-ce716fad3250 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.171003 Aug 10 10:05:18.653857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:18.654922 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 152/302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:18 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:18.659996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:18.660493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:18.660929 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:18.661977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:18.662438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:18.662867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:18.820307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:18.828831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:18.830345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:18.831482 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3f883218-d9a6-4f4b-b119-03be4ff9d9d5 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.183399 Aug 10 10:05:18.832038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 151/303] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:18 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:05:18.904220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:18.904920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:18.910816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:18.911333 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:18.911770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:18.912455 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:18.912909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:18.913336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:19.042799 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:19.050096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2ad87f38-1c5a-45e5-b513-7196a33a5038 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.150293 Aug 10 10:05:19.050657 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 153/304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:18 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:19.167857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:19.168511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:19.174978 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:19.175480 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:19.175948 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:19.176677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:19.177171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:19.177638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:19.305180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:19.313075 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-297c903d-bf20-4e71-aff8-39b4187f4577 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.149123 Aug 10 10:05:19.313646 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 152/305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:19 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:19.674402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:19.675032 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:19.681487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:19.682839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:19.682994 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:19.683598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:19.684059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:19.684482 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:19.814968 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:19.822363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7ad6fc5b-e010-4644-8d31-2afd29b6524d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.151783 Aug 10 10:05:19.823515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 154/306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:19 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:19.853467 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:19.854097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:19.860033 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:19.860515 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:19.860951 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:19.861638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:19.862087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:19.862511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:19.991718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:20.000109 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:20.001883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:20.003007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d210ab78-3152-4ac5-9bc7-3b1c2699239c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.153411 Aug 10 10:05:20.003572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 153/307] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:19 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:20.071291 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:20.072177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:20.079906 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:20.080472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:20.080995 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:20.081772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:20.082297 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:20.082791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:20.222335 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:20.230580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5d33a403-5026-4f48-8444-2aa2b15aaa39 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.162984 Aug 10 10:05:20.231183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 155/308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:20 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:20.334477 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:20.335143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:20.342420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:20.342907 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:20.343373 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:20.344065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:20.344522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:20.344957 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:20.499654 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:20.509261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-598fd6e7-9472-4bea-b896-f6ff0473aae6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.178442 Aug 10 10:05:20.510978 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 154/309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:20 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:20.845690 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:20.847208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:20.861937 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:20.862439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:20.862884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:20.863625 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:20.864104 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:20.864536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:20.883163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:21.027808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:21.028530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:21.042874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:21.044679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:21.045189 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:21.046565 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:21.047064 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:21.047686 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:21.062880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:21.071081 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-52098748-88a7-44e0-8f77-5436f1eeb167 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.230910 Aug 10 10:05:21.071679 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 156/310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:20 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:21.186421 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:21.194711 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:21.196277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:21.197423 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-35805a8f-1f85-4b42-a6b5-71b211474154 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.175526 Aug 10 10:05:21.198616 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 155/311] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:21 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:21.254168 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:21.255099 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:21.262603 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:21.263371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:21.263960 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:21.264842 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:21.265523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:21.266098 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:21.400701 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:21.408427 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e7bae200-e875-40a6-9c74-10dabfbcff0b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.158575 Aug 10 10:05:21.409215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 157/312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:21 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:21.531630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:21.532240 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:21.538717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:21.539241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:21.539682 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:21.540382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:21.540845 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:21.541282 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:21.545418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:21.692780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:21.701902 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-610894ac-6088-4b53-8098-654e0714c967 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.173669 Aug 10 10:05:21.710324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 156/313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:21 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:22.093111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:22.093715 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:22.099915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.100400 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.100834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.101523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.101976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.102407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.220905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:22.221516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:22.233139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.233920 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.234449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.235303 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.235873 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.236422 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.247757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:22.257464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-94e6ab40-41c7-4750-afbf-f342add753c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.168772 Aug 10 10:05:22.258838 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 158/314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:22 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:22.406686 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:22.416202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:22.418065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:22.419363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3a8f05c7-26db-43c9-b296-aad733eb8d4d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.202581 Aug 10 10:05:22.431457 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 157/315] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:22 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:05:22.437012 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:22.437744 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:22.444203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.445027 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.445847 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.446722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.447364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.448477 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.596731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:22.605500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8c4bae08-857e-4914-9d61-c771a0c36cfb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.172565 Aug 10 10:05:22.618573 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 159/316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:22 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:22.725165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:22.725750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:22.732335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.732786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.733232 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.734130 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:22.734727 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:22.735363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:22.876857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:22.884549 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b2ff7e33-384b-4b66-b898-c5c1547c4cc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.164695 Aug 10 10:05:22.898174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 158/317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:22 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:23.278485 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:23.279082 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:23.285810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.286425 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.287006 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:23.287814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.288377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.289010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:23.430083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:23.439200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-239866ad-c45a-4881-8c02-38967976ac3b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.164936 Aug 10 10:05:23.440053 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 160/318] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:23 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:23.447488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:23.448872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:23.455011 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.455491 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.455923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:23.456605 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.457056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.457478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:23.600178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:23.608565 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:23.610228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:23.611372 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-207b6302-7796-4df9-89d3-67e564cd7ddb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.171327 Aug 10 10:05:23.611928 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 159/319] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:23 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:05:23.626322 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:23.626940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:23.633001 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.633403 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.633843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:23.634539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.635025 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.636160 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:23.788258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:23.796517 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-036d8d49-2c83-41c4-9716-7850d3c04df3 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.174269 Aug 10 10:05:23.797107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 161/320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:23 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:23.905352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:23.905993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:23.913913 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.914568 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.915201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:23.917321 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:23.918003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:23.920822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:24.133483 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:24.147697 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-20189d8d-e057-4ed6-ba96-560a4a7315b0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.245862 Aug 10 10:05:24.149841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 160/321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:23 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:24.459504 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:24.460238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:24.468530 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:24.469109 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:24.469630 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:24.470464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:24.471411 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:24.471930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:24.624782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:24.636475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:24.637400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:24.649288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bf791b4b-4808-472c-b8be-7cf2d8f35a99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.192301 Aug 10 10:05:24.651723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 162/322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:24 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:24.652646 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:24.653141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:24.653630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:24.654337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:24.654855 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:24.655327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:24.811630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:24.819028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:24.819642 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:24.825853 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:24.826536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:24.826864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:24.827491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:24.828354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:24.828866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:24.829137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:24.829713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:24.830664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-752ae1a4-e3d7-433a-91c2-35885ce7f909 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.200792 Aug 10 10:05:24.832082 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 161/323] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:24 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:24.990022 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:24.997978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4826d452-3563-4122-a5c2-50f12dcf15d6 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.182730 Aug 10 10:05:24.998880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 163/324] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:24 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:25.169283 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:25.169903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:25.176546 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:25.177039 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:25.177684 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:25.178385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:25.178845 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:25.179300 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:25.326303 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:25.333941 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-53b46623-cb2b-4326-8913-146eb1c98771 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.168622 Aug 10 10:05:25.334521 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 162/325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:25 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:25.671724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:25.672416 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:25.675540 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:25.681285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:25.681867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:25.682414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:25.683713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:25.684200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:25.684775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:25.824646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:25.832645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-61476752-e9bb-4503-a3ad-f289c1ff86d4 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.164796 Aug 10 10:05:25.833227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 164/326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:25 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:25.853599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:25.854261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:25.861075 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:25.861573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:25.862020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:25.862734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:25.863271 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:25.863682 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:26.006406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:26.016350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:26.017861 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:26.019056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-abd912ea-ff1d-49f5-bd17-3d65310ee9bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.169282 Aug 10 10:05:26.019819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 163/327] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:25 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:26.021302 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:26.022031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:26.028413 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:26.028902 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:26.029348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:26.030045 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:26.030506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:26.030938 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:26.185436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:26.193035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ed369fb5-77d9-47f5-a311-05985edf86ee tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.176193 Aug 10 10:05:26.193537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 165/328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:26 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:26.355643 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:26.356261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:26.362707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:26.363230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:26.363672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:26.364363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:26.364821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:26.365248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:26.495763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:26.503521 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-417f5156-74d2-4806-a2c7-9531bf84c725 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.152213 Aug 10 10:05:26.504085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 164/329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:26 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:26.853682 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:26.854945 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:26.861632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:26.862134 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:26.862554 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:26.863271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:26.863754 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:26.864184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.004743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:27.013116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d8b88741-35cc-4b0c-834b-bcc093236aad tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.163616 Aug 10 10:05:27.013930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 166/330] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:26 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:27.041309 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:27.042020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:27.048922 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:27.049676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:27.050237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.051201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:27.051734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:27.052235 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.215062 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:27.215965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:27.224623 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:27.225229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:27.225928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.226806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:27.227338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:27.227840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.233653 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:27.249498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:27.253220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:27.254709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-aedd6df5-986c-43fe-966d-9c8f0d85c7dc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.217297 Aug 10 10:05:27.270889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 165/331] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:27 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:27.525212 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:27.526445 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:27.533554 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:27.534311 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:27.534751 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.536144 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:27.536608 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:27.537091 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.801412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:27.803953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:27.809560 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f2fb4334-dae6-427d-b64d-3684a9a35528 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.599034 Aug 10 10:05:27.810661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 167/332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:27 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:27.812412 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-de40a440-a4e2-4e73-ae5f-2703763e40b6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.291101 Aug 10 10:05:27.823014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 166/333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:27 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:27.823203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-f10092ae-c064-4024-acf3-cf458376e8dc req-376c7aaf-f094-47e0-9ee9-1269bb63a58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14284420-f1ed-4de0-a217-90e8b43f96a0", "tag": "074aae6e-f943-4601-9a0d-aa24ebcb88f4"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:27.825383 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-f10092ae-c064-4024-acf3-cf458376e8dc req-376c7aaf-f094-47e0-9ee9-1269bb63a58b service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:27.825867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-f10092ae-c064-4024-acf3-cf458376e8dc req-376c7aaf-f094-47e0-9ee9-1269bb63a58b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:27.826302 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-f10092ae-c064-4024-acf3-cf458376e8dc req-376c7aaf-f094-47e0-9ee9-1269bb63a58b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:27.837553 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-f10092ae-c064-4024-acf3-cf458376e8dc req-376c7aaf-f094-47e0-9ee9-1269bb63a58b service nova] Creating event network-changed:074aae6e-f943-4601-9a0d-aa24ebcb88f4 for instance 14284420-f1ed-4de0-a217-90e8b43f96a0 on hv-cinder-85083 Aug 10 10:05:27.843042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-f10092ae-c064-4024-acf3-cf458376e8dc req-376c7aaf-f094-47e0-9ee9-1269bb63a58b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030974 Aug 10 10:05:27.843666 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 168/334] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:28.033708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:28.034541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:28.041169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.042323 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.042777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:28.043865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.044450 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.044996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:28.280469 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:28.282319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:28.292470 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.293374 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.293963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:28.295163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.295778 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.296206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:28.349483 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:28.358664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dabff05b-30b9-4657-a4c6-9e151865ed82 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.328815 Aug 10 10:05:28.371425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 167/335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:28 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:28.512084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:28.522564 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:28.524256 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:28.525370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07add7ad-3bdd-4a0b-b6f6-1aae2fc98d8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1407 microversion: 2.20 time: 0.251142 Aug 10 10:05:28.526501 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 169/336] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:28 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:05:28.833769 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:28.836458 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:28.837458 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:28.837808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:28.844599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.850783 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.851436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.851907 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:28.852963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.852963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:28.853865 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.854533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:28.855104 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.855602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:28.856129 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:28.861230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:29.126290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:29.128851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:29.142935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-04e07832-c918-4790-933d-7e96aae118a4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.313240 Aug 10 10:05:29.147377 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-43e2e913-414c-401d-8814-bbdcecb71fbf tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.320061 Aug 10 10:05:29.160665 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 168/337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:28 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:29.160862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 170/338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:28 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:29.379798 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:29.380416 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:29.386818 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:29.387538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:29.388144 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:29.389007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:29.389606 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:29.390174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:29.524028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:29.532488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f31302b9-f6b4-4129-bdaf-f93a4cb3a09c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.156755 Aug 10 10:05:29.533067 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 169/339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:29 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:29.556584 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:29.557359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:29.564840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:29.565336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:29.566380 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:29.567123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:29.567589 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:29.568035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:29.775433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:29.790263 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:29.792940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:29.794325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f1677a07-549f-4b74-88e6-5a635f52f50e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1599 microversion: 2.20 time: 0.242064 Aug 10 10:05:29.805899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 171/340] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:05:29 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1599 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:05:29.818844 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:29.819368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:29.827420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:29.827938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:29.828349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:29.829050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:29.829684 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:29.830293 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:29.951118 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c997d61c-07e7-4f43-9d25-7bef136e08f1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.137330 Aug 10 10:05:29.952593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 170/341] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 10 10:05:29 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:05:30.177727 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:30.180931 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:30.181664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:30.185097 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:30.196072 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:30.197863 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:30.198517 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:30.199564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:30.200006 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:30.202105 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:30.203504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:30.204155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:30.205842 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:30.206050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:30.206666 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:30.208775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:30.808757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:30.816147 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c34abf46-99a4-4314-b7d8-866b35965c10 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.650415 Aug 10 10:05:30.816709 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 172/342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:30 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:30.821131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:30.821731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:30.827769 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:30.828252 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:30.828687 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:30.829370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:30.829823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:30.830248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:30.848009 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:30.855566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-799031ba-526c-460c-9e12-62e7d76ba2bf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.687408 Aug 10 10:05:30.856274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 171/343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:30 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:31.032398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:31.035947 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:31.040845 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d095db11-29b6-4c60-bcd3-78125e6820e2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.223183 Aug 10 10:05:31.041707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 173/344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:30 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:31.470336 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-c27095b0-a754-4ece-a2d7-5ef1496dc1b4 req-4de8f0e8-4034-4f19-880b-db0895e449d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9", "tag": "572a9818-c1ee-4385-bd79-7c0a76329a99"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:31.480610 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-c27095b0-a754-4ece-a2d7-5ef1496dc1b4 req-4de8f0e8-4034-4f19-880b-db0895e449d3 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:31.481092 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-c27095b0-a754-4ece-a2d7-5ef1496dc1b4 req-4de8f0e8-4034-4f19-880b-db0895e449d3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:31.481526 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-c27095b0-a754-4ece-a2d7-5ef1496dc1b4 req-4de8f0e8-4034-4f19-880b-db0895e449d3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:31.492436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-c27095b0-a754-4ece-a2d7-5ef1496dc1b4 req-4de8f0e8-4034-4f19-880b-db0895e449d3 service nova] Creating event network-changed:572a9818-c1ee-4385-bd79-7c0a76329a99 for instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 on hv-cinder-85083 Aug 10 10:05:31.497967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-c27095b0-a754-4ece-a2d7-5ef1496dc1b4 req-4de8f0e8-4034-4f19-880b-db0895e449d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031209 Aug 10 10:05:31.498679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 172/345] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:05:31.836904 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:31.837460 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:31.844429 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:31.844931 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:31.845370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:31.846059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:31.846511 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:31.846935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:31.877467 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:31.878349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:31.884674 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:31.885342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:31.885884 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:31.886837 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:31.887344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:31.887783 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:32.033944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:32.046119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4bc7bd95-f1b4-4182-81a7-d54c37cee74e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.212960 Aug 10 10:05:32.056365 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 174/346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:31 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:32.067609 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:32.068379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:32.074999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:32.075937 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:32.076535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:32.077559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:32.078079 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:32.078783 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:32.079527 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:32.079790 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:32.084610 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-75cd9430-2b93-4dbc-a719-8382728f2984 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.211739 Aug 10 10:05:32.085187 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 173/347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:31 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:32.215631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:32.223212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-791edf27-c063-471d-96a5-06ac26ea549a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.159536 Aug 10 10:05:32.223783 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 175/348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:32 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:33.069572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:33.070241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:33.073820 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:33.077222 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.077896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.078341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.079078 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.079702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.080128 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.106774 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:33.107759 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:33.114690 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.115525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.115975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.116686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.117329 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.118579 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.269014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:33.276967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6b53948b-dbfa-401b-875b-ac2dabee45d2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.211161 Aug 10 10:05:33.277547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 174/349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:33 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:33.282226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:33.282843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:33.289856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.290728 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.291950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.292664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.293129 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.293564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.294126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:33.301815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7cd1c025-5560-49ed-9adc-8e3d3b24f1c3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.199886 Aug 10 10:05:33.302410 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 176/350] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:33 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:33.427849 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:33.435788 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6a6234d5-cfe1-4597-bc7d-b10b070ed018 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.157295 Aug 10 10:05:33.436393 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 175/351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:33 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:33.685257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:33.685761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:33.691812 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.692300 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.692740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.693433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:33.693896 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:33.694325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:33.826018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lazy-loading 'services' on Instance uuid 8051dcee-4ed6-4b3d-87de-bc26e85c971e {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:05:33.942898 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3077bdc3-ce54-4bfa-b031-52c721a961bc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e/os-volume_attachments/48768710-498b-4883-a225-9cf065d02a97" status: 202 len: 0 microversion: 2.1 time: 0.262004 Aug 10 10:05:33.943518 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 177/352] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:05:33 2022] DELETE /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e/os-volume_attachments/48768710-498b-4883-a225-9cf065d02a97 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:05:34.299006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:34.299620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:34.307739 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:34.308429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:34.309019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:34.309898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:34.310501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:34.311115 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:34.327208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:34.328824 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:34.349443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:34.350001 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:34.350530 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:34.351533 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:34.352053 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:34.352678 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:34.512136 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:34.519658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b4353d68-5c23-4e69-93dd-dc322550fecc tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.224741 Aug 10 10:05:34.520318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 176/353] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:34 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:34.524800 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:34.526324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:34.534027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:34.534523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:34.534977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:34.535707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:34.536150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:34.536579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:34.557936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:34.567359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-42f75644-79b7-4acc-bf66-e1277fb3cba7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.246784 Aug 10 10:05:34.568699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 178/354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:34 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:34.665604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:34.673003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dbfb2a73-28ab-41ef-ab14-10f696e887da tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.151652 Aug 10 10:05:34.673572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 177/355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:34 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:35.540575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:35.541925 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:35.549983 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:35.550717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:35.551348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:35.552261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:35.552893 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:35.553482 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:35.592201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:35.592835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:35.604552 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:35.605058 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:35.609288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:35.610111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:35.610600 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:35.611065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:35.874754 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:35.883067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6eefd31c-8e3b-4516-9385-d1d5e7067b91 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.346206 Aug 10 10:05:35.884026 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 179/356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:35 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:35.899486 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:35.902451 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:35.907226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:35.911269 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:35.912747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:35.913380 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:35.914474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:35.915237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:35.916414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:35.916889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-32cf66d3-85b6-40d5-bfb3-9a65986532f1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.329565 Aug 10 10:05:35.917815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 178/357] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:35 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:36.097910 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:36.110440 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-59679f6d-c863-4ed7-82f9-bf7295c5a73a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.225129 Aug 10 10:05:36.123940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 180/358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:35 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:36.906848 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:36.907448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:36.913907 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:36.914390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:36.914828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:36.915587 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:36.915992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:36.916416 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:36.939946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:36.940564 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:36.947087 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:36.948362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:36.948815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:36.949520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:36.949975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:36.950429 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.099770 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:37.111292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-75e68f2e-028f-41fa-a3e2-8a5e60e19a56 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.208014 Aug 10 10:05:37.112644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 179/359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:36 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:37.136178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:37.137097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:37.137214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:37.144517 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:37.145121 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a945c442-69ec-403f-a34f-792c1931322a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.208905 Aug 10 10:05:37.145651 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:37.145901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 181/360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:36 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:37.146667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.147652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:37.148480 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:37.150018 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.231332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:37.231951 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:37.238635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:37.240588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:37.241523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.242923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:37.243865 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:37.245141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.271967 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:05:37.300881 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:37.309777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-13bf1097-2e1e-437f-b24a-361c01c79189 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.180441 Aug 10 10:05:37.312703 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 180/361] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:37 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:37.318597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-f65edf0e-b79d-40ab-a5ee-4ccd3ed50fff req-23d7f76d-045d-4bd2-9d89-280cd5dccad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14284420-f1ed-4de0-a217-90e8b43f96a0", "name": "network-vif-plugged", "status": "completed", "tag": "074aae6e-f943-4601-9a0d-aa24ebcb88f4"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:37.331708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-f65edf0e-b79d-40ab-a5ee-4ccd3ed50fff req-23d7f76d-045d-4bd2-9d89-280cd5dccad6 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:37.332595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-f65edf0e-b79d-40ab-a5ee-4ccd3ed50fff req-23d7f76d-045d-4bd2-9d89-280cd5dccad6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:37.333250 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-f65edf0e-b79d-40ab-a5ee-4ccd3ed50fff req-23d7f76d-045d-4bd2-9d89-280cd5dccad6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.345865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-f65edf0e-b79d-40ab-a5ee-4ccd3ed50fff req-23d7f76d-045d-4bd2-9d89-280cd5dccad6 service nova] Creating event network-vif-plugged:074aae6e-f943-4601-9a0d-aa24ebcb88f4 for instance 14284420-f1ed-4de0-a217-90e8b43f96a0 on hv-cinder-85083 Aug 10 10:05:37.352128 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-f65edf0e-b79d-40ab-a5ee-4ccd3ed50fff req-23d7f76d-045d-4bd2-9d89-280cd5dccad6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037922 Aug 10 10:05:37.352883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 181/362] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:37.375266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-875870ba-20a3-4971-a766-980d6937ef72 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 204 len: 0 microversion: 2.1 time: 0.147268 Aug 10 10:05:37.376122 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 182/363] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:05:37 2022] DELETE /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:05:37.385190 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:37.385949 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:37.392151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:37.392737 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:37.393289 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.394162 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:37.394666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:37.395349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:37.530873 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:37.538677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-83efdb4b-6104-4751-ac8a-fd8ab3b2e644 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1513 microversion: 2.1 time: 0.158162 Aug 10 10:05:37.539274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 182/364] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:37 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:38.134167 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:38.134878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:38.141581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.142073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.142519 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.143251 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.143719 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.144152 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.165839 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:38.167267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:38.173714 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.174401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.174847 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.175625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.176030 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.176501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.360990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:38.366182 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:38.375451 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-920f8491-bd24-4573-9e5a-cd24527737e4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.245423 Aug 10 10:05:38.376055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6de06a77-be5d-46ac-9ee0-ea120d6ce1e4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.213575 Aug 10 10:05:38.376640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 183/366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:38 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:38.376786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 183/366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:38 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:38.383052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:38.383853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:38.404096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.404624 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.405091 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.405809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.406274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.406710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.544063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:38.552343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-96d0ef3e-d703-4a84-8cf1-0ed97416116f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.173036 Aug 10 10:05:38.552920 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 184/367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:38 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:38.559322 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:38.559966 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:38.569957 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.570451 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.570895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.571637 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:38.572100 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:38.572560 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:38.762203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:38.769625 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-905ad5e3-d111-464a-9b1e-21147eae4d9b tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1513 microversion: 2.1 time: 0.214285 Aug 10 10:05:38.770203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 184/368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:38 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:39.370752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-910eef66-05f5-4190-8498-a21c735b3104 req-649b8f94-789f-4001-9a0c-f8d69d3415e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3acf77a6-2970-4d9a-aee8-46e37fe3a0bb", "name": "network-vif-plugged", "status": "completed", "tag": "72577d9b-8949-4110-8e7a-5678ee2987d0"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:39.380811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-910eef66-05f5-4190-8498-a21c735b3104 req-649b8f94-789f-4001-9a0c-f8d69d3415e1 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.381297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-910eef66-05f5-4190-8498-a21c735b3104 req-649b8f94-789f-4001-9a0c-f8d69d3415e1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.381731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-910eef66-05f5-4190-8498-a21c735b3104 req-649b8f94-789f-4001-9a0c-f8d69d3415e1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.393020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-910eef66-05f5-4190-8498-a21c735b3104 req-649b8f94-789f-4001-9a0c-f8d69d3415e1 service nova] Creating event network-vif-plugged:72577d9b-8949-4110-8e7a-5678ee2987d0 for instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb on hv-cinder-85083 Aug 10 10:05:39.397197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:39.397820 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:39.403921 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-910eef66-05f5-4190-8498-a21c735b3104 req-649b8f94-789f-4001-9a0c-f8d69d3415e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036775 Aug 10 10:05:39.407171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.407957 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 185/369] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:39.408167 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.408803 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.409550 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.410045 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.410510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.413149 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:39.414010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:39.420900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.421388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.421827 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.422530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.423012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.423441 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.610103 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:39.614630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:39.617672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-136755b1-33a8-4969-a3e4-d9e5339c909b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.224240 Aug 10 10:05:39.618248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 185/370] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:39 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:39.623673 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:39.624287 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:39.629042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a2a4ace6-e76c-431a-9341-6299eedaef74 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.219852 Aug 10 10:05:39.630173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.630665 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.631195 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.631716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 186/371] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:39 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:39.632067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.632529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.633130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.773437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:39.780934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6ddec2ac-daf3-4d81-bc9d-89eb70f5fe86 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.160749 Aug 10 10:05:39.781483 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 186/372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:39 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:39.792210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:39.792965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:39.799278 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.799850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.800295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.801161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:39.801825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:39.802261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:39.946006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:39.963822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3d9ca2f5-2167-4810-b02e-254059993f17 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1513 microversion: 2.1 time: 0.174893 Aug 10 10:05:39.964670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 187/373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:39 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:40.640003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:40.640634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:40.647407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.648093 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.648681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:40.649487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.650103 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.651180 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:40.653045 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:40.653871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:40.661081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.661647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.662165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:40.662934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.663526 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.664102 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:40.906891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:40.912295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:40.914587 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-55df0ee3-e058-46d1-85c6-1c990cd39b3e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.278812 Aug 10 10:05:40.915190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 187/374] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:40 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:40.920464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:40.921085 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:40.926829 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.927353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.927798 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:40.928514 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.928976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.929401 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:40.934003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:40.944257 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-07632288-3f46-44ba-8a66-31c0b3e9885c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.295802 Aug 10 10:05:40.946132 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 188/375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:40 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:40.985158 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:40.985853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:40.992160 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.992677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.993259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:40.993848 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:40.994847 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:40.995829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:41.129448 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:41.137000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cc7cfed9-e600-4b81-8064-d9e725887bf0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.220657 Aug 10 10:05:41.137656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 188/376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:40 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:41.156352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:41.163769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-748e07c4-64e4-4b93-88b5-611a8651ea9e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1513 microversion: 2.1 time: 0.182631 Aug 10 10:05:41.164335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 189/377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:40 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:41.938106 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:41.939129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:41.945422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:41.945980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:41.946561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:41.947928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:41.948488 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:41.948967 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:41.974019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:41.974732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:41.981668 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:41.982232 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:41.982798 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:41.983634 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:41.984147 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:41.984683 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.213408 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:42.221736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f1a099b6-249d-427e-9a83-912ed1eb834b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1358 microversion: 2.1 time: 0.287572 Aug 10 10:05:42.222315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 189/378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:41 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:42.227161 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:42.227971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:42.237143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.238381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.239391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.240600 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.241170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.241994 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.245896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:42.253702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-36ca59d2-70fb-4da4-8ab5-abf68bc3443b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1500 microversion: 2.1 time: 0.283548 Aug 10 10:05:42.254667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 190/379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:41 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1500 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:42.259377 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-81a0188c-f9b4-42cc-b646-fbf7d192d2d8 req-c38a3bb0-c166-4ee9-ab05-6648e30066c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8051dcee-4ed6-4b3d-87de-bc26e85c971e", "name": "network-vif-deleted", "tag": "a3850c28-4943-4aa2-94d2-3dc9fe679ef9"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:42.269309 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-81a0188c-f9b4-42cc-b646-fbf7d192d2d8 req-c38a3bb0-c166-4ee9-ab05-6648e30066c3 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.269784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-81a0188c-f9b4-42cc-b646-fbf7d192d2d8 req-c38a3bb0-c166-4ee9-ab05-6648e30066c3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.270551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-81a0188c-f9b4-42cc-b646-fbf7d192d2d8 req-c38a3bb0-c166-4ee9-ab05-6648e30066c3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.281890 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-81a0188c-f9b4-42cc-b646-fbf7d192d2d8 req-c38a3bb0-c166-4ee9-ab05-6648e30066c3 service nova] Creating event network-vif-deleted:a3850c28-4943-4aa2-94d2-3dc9fe679ef9 for instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e on hv-cinder-85083 Aug 10 10:05:42.287280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-81a0188c-f9b4-42cc-b646-fbf7d192d2d8 req-c38a3bb0-c166-4ee9-ab05-6648e30066c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Aug 10 10:05:42.288191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 191/380] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:42.293323 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:42.294195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:42.301795 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.302653 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.303191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.304092 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.304572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.305390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.329462 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:42.394492 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:42.403623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-209c6dc3-c674-49a7-a268-8318f8e5ad81 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1471 microversion: 2.1 time: 0.113614 Aug 10 10:05:42.404217 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 192/381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:42 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:42.416745 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f930121-2b00-4fe9-b724-a2f5b12db0ca"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:42.419085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:42.427915 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.428713 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.429254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.430059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.430726 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.431252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.455270 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] HTTP exception thrown: Cannot 'attach_volume' instance a7915e13-08f0-47b2-a0a9-334681c80ae6 while it is in vm_state rescued Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Request method failure captured: Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: POST /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6/os-volume_attachments HTTP/1.1 Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 74 Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JhpWbH-qE-vLLswXpK03OlT8lk-cXsSH3k7Avifv_u_dOkLQ-2P0_W_annA_hwJh9vgtjslFKTGI8qvokEMcBfB7sxdLJzJo0Cxu82SqjaQdY6y0qLfKf6sqdTLNJqPJPW6QhV5jCYxANMgXAT2F2M3iVogGVjxwuBONtYn366o6w Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:05:42.457534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}] Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: befbca3738f0481296b63c70d6d2a797 Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {"volumeAttachment": {"volumeId": "9f930121-2b00-4fe9-b724-a2f5b12db0ca"}} Aug 10 10:05:42.459201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Cannot 'attach_volume' instance a7915e13-08f0-47b2-a0a9-334681c80ae6 while it is in vm_state rescued Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'server_id': 'a7915e13-08f0-47b2-a0a9-334681c80ae6', 'body': {'volumeAttachment': {'volumeId': '9f930121-2b00-4fe9-b724-a2f5b12db0ca'}}} Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a7915e13-08f0-47b2-a0a9-334681c80ae6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:05:42.460199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a7915e13-08f0-47b2-a0a9-334681c80ae6 while it is in vm_state rescued Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:05:42.461496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:05:42.462596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:05:42.462596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:05:42.462596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a7915e13-08f0-47b2-a0a9-334681c80ae6 while it is in vm_state rescued Aug 10 10:05:42.462596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:05:42.462596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Returning 409 to user: Cannot 'attach_volume' instance a7915e13-08f0-47b2-a0a9-334681c80ae6 while it is in vm_state rescued {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:05:42.462596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d5bd9bce-14c3-4280-a95d-f982ad60ec69 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054326 Aug 10 10:05:42.462596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 193/382] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:05:42 2022] POST /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 10:05:42.469774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:42.470317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:42.470659 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:42.476559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.477055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.477509 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.479715 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.480191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.480659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.480767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d5630ed3-9f6c-4021-8869-aa7ea27bb2fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1366 microversion: 2.1 time: 0.257104 Aug 10 10:05:42.481286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 190/383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:42 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:42.552703 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6add47b0-4314-4e4a-9058-8450c25e4b20 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6/action" status: 202 len: 0 microversion: 2.1 time: 0.087220 Aug 10 10:05:42.553327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 194/384] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:05:42 2022] POST /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:05:42.561680 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:42.562294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:42.568503 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.569031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.569472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.570162 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:42.570629 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:42.571141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:42.707476 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:42.714876 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1a795660-ade8-4bda-96a5-187332c1677e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1508 microversion: 2.1 time: 0.157161 Aug 10 10:05:42.715479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 191/385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:42 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:43.244559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:43.245368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:43.251977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.252463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.252909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.253604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.254063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.254581 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.387241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:43.394571 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1ea7b6c1-a032-47cb-8bcc-ea62efd89a03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1549 microversion: 2.1 time: 0.156209 Aug 10 10:05:43.395543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 195/386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:43 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:43.417330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:43.418011 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:43.424813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:43.425436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.425616 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:43.426336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.427105 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.427948 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.428483 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.428918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.432440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.432928 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.433373 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.434065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.434523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.434967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.518901 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:43.528328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-44fe6c34-e2a5-4a39-8d61-4b947fd058e8 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1304 microversion: 2.1 time: 0.107593 Aug 10 10:05:43.529005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 196/387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:43 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:43.533953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:43.534752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:43.542700 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.543238 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.543681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.544394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.544860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.545291 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.606872 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:43.614834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6bec7c32-b05d-4601-b4a0-8263e0e844c2 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1549 microversion: 2.1 time: 0.201760 Aug 10 10:05:43.615766 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 192/388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:43 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1549 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:43.642030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:43.651149 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:43.654375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Searching by: {'deleted': False, 'project_id': '281a4bf45d474217a84a31cee8128a87'} {{(pid=117896) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 10:05:43.664177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.664764 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.665512 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.666792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.667257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.667683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.767665 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.multi_cell_list [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117896) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 10:05:43.867365 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d20990a2-c5c3-424e-9e28-f3ada3cee0a5 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.234606 Aug 10 10:05:43.868084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 193/389] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Aug 10 10:05:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:05:43.872696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:43.873349 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:43.879713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.880212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.880677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.881394 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.881858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.882295 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.962089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:43.970390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f5a078e4-567d-4ce7-a25c-7cc265022c52 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1556 microversion: 2.1 time: 0.440257 Aug 10 10:05:43.970972 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 197/390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:43 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1556 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:43.975337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:43.975941 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:43.982706 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.983216 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.983825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:43.984516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:43.984970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:43.985394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:44.034871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:44.042764 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9ce85f48-6189-4f91-966a-ade71dc426a2 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1508 microversion: 2.1 time: 0.173910 Aug 10 10:05:44.043354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 194/391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:43 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:44.048984 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:44.049479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:44.055521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:44.055521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:44.055972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:44.056689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:44.057149 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:44.057575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:44.155637 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:44.167514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1fb74470-fb8a-4959-9019-31645a3b72f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1549 microversion: 2.1 time: 0.195520 Aug 10 10:05:44.168202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 198/392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:43 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:44.170398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2a483250-788e-41d2-b8a8-8706f16f4cf2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125579 Aug 10 10:05:44.170590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 195/393] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:05:44 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:44.554966 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:44.556248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:44.566493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:44.567343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:44.568069 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:44.568969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:44.569432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:44.569893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:44.613987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:44.614489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:44.614936 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:44.615420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lazy-loading 'fault' on Instance uuid 8051dcee-4ed6-4b3d-87de-bc26e85c971e {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:05:44.712481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:44.721534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3c85a342-3105-4aab-b340-19fd6a487ac2 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 200 len: 1309 microversion: 2.1 time: 0.174321 Aug 10 10:05:44.736441 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 199/394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:44 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:45.065548 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:45.067059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:45.074636 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:45.075171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:45.075809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:45.076675 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:45.077341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:45.078096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:45.210853 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:45.218809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5c355e0a-39dc-4daa-8d62-f5d06b63446e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1508 microversion: 2.1 time: 0.158348 Aug 10 10:05:45.219341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 196/395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:45 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:45.473710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-1d64bdab-6160-4f6f-af13-4c6399b140bb req-39981b45-033b-48c7-b1ff-2e92dd3e480a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14284420-f1ed-4de0-a217-90e8b43f96a0", "tag": "074aae6e-f943-4601-9a0d-aa24ebcb88f4"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:45.483455 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-1d64bdab-6160-4f6f-af13-4c6399b140bb req-39981b45-033b-48c7-b1ff-2e92dd3e480a service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:45.484232 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-1d64bdab-6160-4f6f-af13-4c6399b140bb req-39981b45-033b-48c7-b1ff-2e92dd3e480a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:45.484357 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-1d64bdab-6160-4f6f-af13-4c6399b140bb req-39981b45-033b-48c7-b1ff-2e92dd3e480a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:45.496037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-1d64bdab-6160-4f6f-af13-4c6399b140bb req-39981b45-033b-48c7-b1ff-2e92dd3e480a service nova] Creating event network-changed:074aae6e-f943-4601-9a0d-aa24ebcb88f4 for instance 14284420-f1ed-4de0-a217-90e8b43f96a0 on hv-cinder-85083 Aug 10 10:05:45.502753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-1d64bdab-6160-4f6f-af13-4c6399b140bb req-39981b45-033b-48c7-b1ff-2e92dd3e480a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031529 Aug 10 10:05:45.502753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 200/396] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:45.752961 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:45.753715 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 8051dcee-4ed6-4b3d-87de-bc26e85c971e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:45.760705 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:45.761871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:45.762674 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2479429f-1e57-4606-8b2c-fb5bbf4d1965"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:45.763323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:45.764057 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:45.764525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:45.764959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:45.765151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:45.771853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:45.772525 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:45.773333 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:45.774194 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:45.774649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:45.775856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:45.780404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] HTTP exception thrown: Instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e could not be found. Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Request method failure captured: Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e HTTP/1.1 Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84KXMjPvygi5F_kggw09VZkLFBAp6FdqJhUGBRqOSDlYIV3XcB71a6mGF8r2EtOAKYbZJSfWtCXpp2YaVQUnplGrmBXGdlQ3IpZA08gB5TaJpIs513QBz318Aj-qngq_ESZn1TTi1QJOwa2FyOlyOvWa21W6zURRuxhBbJFzl9qlIfI Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 0c42b50ff98c40a6b2f47f289538a330 Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1937306643 Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:05:45.782146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0c42b50ff98c40a6b2f47f289538a330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c42b50ff98c40a6b2f47f289538a330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0c42b50ff98c40a6b2f47f289538a330"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c42b50ff98c40a6b2f47f289538a330"}]}] Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesSnapshotTestJSON-1937306643 Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 0c42b50ff98c40a6b2f47f289538a330 Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1937306643 Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesSnapshotTestJSON-1937306643-project Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 55ae4dbafed74e9dbeab9538898cf1f6 Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesSnapshotTestJSON-1937306643-project Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e could not be found. Aug 10 10:05:45.783474 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '8051dcee-4ed6-4b3d-87de-bc26e85c971e'} Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e could not be found. Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:05:45.784217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e could not be found. Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e could not be found. Aug 10 10:05:45.785497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:05:45.786539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Returning 404 to user: Instance 8051dcee-4ed6-4b3d-87de-bc26e85c971e could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:05:45.786539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-57f42942-3d3d-4683-8edd-7772c46cb12c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e" status: 404 len: 111 microversion: 2.1 time: 0.036894 Aug 10 10:05:45.786539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 197/397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:45 2022] GET /compute/v2.1/servers/8051dcee-4ed6-4b3d-87de-bc26e85c971e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:05:46.242407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:46.243072 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:46.250163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:46.250926 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:46.251366 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:46.252065 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:46.252519 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:46.252942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:46.389036 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:46.396750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a239498e-0919-4dcc-92d6-964773951696 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1508 microversion: 2.1 time: 0.160177 Aug 10 10:05:46.397591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 198/398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:46 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:47.417598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:47.418208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:47.424718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:47.425200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:47.425635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:47.426316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:47.426770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:47.427223 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:47.553937 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:47.561869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-df12256c-440f-46ef-b34e-d388b7cb6b81 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1508 microversion: 2.1 time: 0.148141 Aug 10 10:05:47.562439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 199/399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:47 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:48.583425 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:48.584037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:48.591287 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:48.591768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:48.592211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:48.592898 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:48.593352 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:48.593779 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:48.732525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:48.739867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-51819509-db92-4c90-924d-9ff688809ffb tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1508 microversion: 2.1 time: 0.160261 Aug 10 10:05:48.740461 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 200/400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:48 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:49.284775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5b2eee5a-09c2-4586-8b9b-c511eeac4f4b tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.529984 Aug 10 10:05:49.285598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 201/401] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:05:45 2022] POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments => generated 194 bytes in 3532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:49.761105 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:49.762096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:49.768851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:49.769602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:49.770262 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:49.771208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:49.771860 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:49.772681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:49.917011 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:49.925107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2cbff6a3-5fb7-4336-bff8-e288ff58ab28 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1508 microversion: 2.1 time: 0.167828 Aug 10 10:05:49.925698 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 201/402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:49 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:50.948478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:50.949291 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:50.955424 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:50.956007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:50.956511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:50.957270 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:50.957857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:50.958292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:51.094584 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:51.102161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d53bd6aa-0d31-407f-9dee-a2f655d19dca tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1514 microversion: 2.1 time: 0.159008 Aug 10 10:05:51.102730 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 202/403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:50 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:53.817146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-840218691", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "networks": [{"uuid": "e7a27918-6d3b-4682-9cc8-50b91115fba4"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:53.828167 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:53.877931 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] validate_networks() for [('e7a27918-6d3b-4682-9cc8-50b91115fba4', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:05:54.388328 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:05:54.388761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:05:54.389247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:05:54.389664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:05:54.390116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:05:54.399862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:54.400357 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:54.400805 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:54.401602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:54.402071 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:54.402506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:54.422438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Getting quotas for project 0c42b50ff98c40a6b2f47f289538a330. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:05:54.426526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Getting quotas for user 55ae4dbafed74e9dbeab9538898cf1f6 and project 0c42b50ff98c40a6b2f47f289538a330. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:05:54.438519 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:05:54.440840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:05:54.489083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e308d3d2-c6f8-425d-bcd9-b62b6880650c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675934 Aug 10 10:05:54.489799 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 202/404] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:05:54.501068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-999d8871-01d2-46a4-94f2-6643f5bd8b33 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:54.502207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-999d8871-01d2-46a4-94f2-6643f5bd8b33 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:54.568329 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-999d8871-01d2-46a4-94f2-6643f5bd8b33 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:54.579415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-999d8871-01d2-46a4-94f2-6643f5bd8b33 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1218 microversion: 2.1 time: 0.082155 Aug 10 10:05:54.580599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 203/405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:54 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:54.622768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-44e46cfe-fe4a-4711-b7f5-8b846c284adf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'create', calling method: .version_select at 0x7f2308887e50>, body: {"keypair": {"name": "tempest-keypair-589177271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/SHqaYBFD+9ja7uNOlPbXDZz3UKGVTnR/RfFi4fJPWnCrxBWBKLYxj+SkKIPQDhK95gLnC8IF1u6ZH/KKx1spRXOpGeYqG4GBVlaKkYZH4yvTVsW7NOuL/WY3D2s+Eyw=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:54.658078 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:54.671953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-44e46cfe-fe4a-4711-b7f5-8b846c284adf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for project fbbf8047a09b4fee9a12288ef323338c. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:05:54.678094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-44e46cfe-fe4a-4711-b7f5-8b846c284adf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for user befbca3738f0481296b63c70d6d2a797 and project fbbf8047a09b4fee9a12288ef323338c. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:05:54.717396 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-44e46cfe-fe4a-4711-b7f5-8b846c284adf tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099334 Aug 10 10:05:54.718259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 203/406] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:05:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:55.605395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:55.606643 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:55.616243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:55.617162 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:55.617777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:55.618717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:55.619368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:55.619985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:55.723530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:55.735961 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2432d59c-9c2f-4e28-b765-1be3323f64d7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1270 microversion: 2.1 time: 0.133763 Aug 10 10:05:55.744194 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 204/407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:55 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:56.485108 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-685910834", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17c8f29a-7fae-4dd5-b45d-4f577fc49244"}], "security_groups": [{"name": "tempest-securitygroup--1348612477"}], "key_name": "tempest-keypair-589177271", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:56.670633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] validate_networks() for [('17c8f29a-7fae-4dd5-b45d-4f577fc49244', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:05:56.762245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:56.763070 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:56.774578 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:56.778503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:56.779614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:56.780649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:56.784852 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:56.788969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:56.969614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:56.984625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e6f1e8b1-5a41-484f-a11a-ca63a0e3fe29 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1278 microversion: 2.1 time: 0.224665 Aug 10 10:05:56.986734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 205/408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:56 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:05:57.628667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:05:57.631487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:05:57.632502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:05:57.633737 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:05:57.635564 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:05:57.649137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:57.649989 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:57.651003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:57.651953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:57.653006 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:57.653666 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:57.674230 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for project fbbf8047a09b4fee9a12288ef323338c. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:05:57.678704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Getting quotas for user befbca3738f0481296b63c70d6d2a797 and project fbbf8047a09b4fee9a12288ef323338c. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:05:57.692899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:05:57.695384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:05:57.760619 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dd2abaee-fc72-4998-9e94-f436413aa777 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.282902 Aug 10 10:05:57.762124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 204/409] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:05:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:05:57.773149 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-de0a3c73-e231-439d-a94a-a8d05f99abda tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:57.774750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-de0a3c73-e231-439d-a94a-a8d05f99abda tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:57.926277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-de0a3c73-e231-439d-a94a-a8d05f99abda tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:57.944029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-de0a3c73-e231-439d-a94a-a8d05f99abda tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1244 microversion: 2.1 time: 0.170615 Aug 10 10:05:57.948475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 206/410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:57 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1244 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:58.014218 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:58.014971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:58.025306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:58.029204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:58.029867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:58.031997 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:58.033522 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:58.033968 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:58.282618 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:58.283413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:58.293564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:58.294089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:58.294478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:58.300095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:58.300719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:58.301144 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:58.343431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:58.354295 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-50493ba9-a3d1-4297-9a49-8206191b960c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.346007 Aug 10 10:05:58.367782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 205/411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:58 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:58.605237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:58.618825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ad4b69df-95ce-49c4-9d90-101aeaaacb03 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1595 microversion: 2.1 time: 0.340507 Aug 10 10:05:58.631218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 207/412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:58 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1595 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:58.973376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:58.974088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:58.994614 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:58.995140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:58.995585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:58.996325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:58.996746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:58.997175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:59.157905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:59.184614 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ed0ba6f7-6d44-4380-918b-8b2a29a0fcc1 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1296 microversion: 2.1 time: 0.215958 Aug 10 10:05:59.218300 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 206/413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:58 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1296 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:05:59.353486 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-4f201e14-2653-43f8-bf77-533b0e45939c req-8d741d49-6af6-42ac-a041-e1ffad5d5dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e9b1f3-3de1-47c6-8789-c37b4c5c8542", "tag": "69ed488f-c5fd-4bfe-942f-80603f3e88ae"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:05:59.377810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:05:59.378448 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:05:59.380520 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4f201e14-2653-43f8-bf77-533b0e45939c req-8d741d49-6af6-42ac-a041-e1ffad5d5dd6 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:59.381407 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4f201e14-2653-43f8-bf77-533b0e45939c req-8d741d49-6af6-42ac-a041-e1ffad5d5dd6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:59.382050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4f201e14-2653-43f8-bf77-533b0e45939c req-8d741d49-6af6-42ac-a041-e1ffad5d5dd6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:59.392461 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:59.392975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:59.393424 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:59.398874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-4f201e14-2653-43f8-bf77-533b0e45939c req-8d741d49-6af6-42ac-a041-e1ffad5d5dd6 service nova] Creating event network-changed:69ed488f-c5fd-4bfe-942f-80603f3e88ae for instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 on hv-cinder-85083 Aug 10 10:05:59.401869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:05:59.402754 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:05:59.403606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:05:59.405408 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-4f201e14-2653-43f8-bf77-533b0e45939c req-8d741d49-6af6-42ac-a041-e1ffad5d5dd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065539 Aug 10 10:05:59.408768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 208/414] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:05:59.727976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:05:59.732162 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:59.738990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-23f9556e-fd85-4848-9171-0ab35f86d78c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.366893 Aug 10 10:05:59.739794 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 207/415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:05:59 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:00.222344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:00.223709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:00.231797 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:00.232621 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:00.233346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:00.234283 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:00.235024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:00.235675 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:00.336063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:00.355819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e6af3057-645b-414b-9907-cc410b078203 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1302 microversion: 2.1 time: 0.134605 Aug 10 10:06:00.358215 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 209/416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:00 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1302 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:00.766214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:00.767627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:00.776232 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:00.777085 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:00.777821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:00.780950 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:00.781543 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:00.782144 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:00.979563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:00.991830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e12b0272-aa71-4809-8005-32ceedaf75a7 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.233288 Aug 10 10:06:00.992922 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 208/417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:00 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:01.379380 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:01.381057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:01.411129 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:01.411129 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:01.411471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:01.412283 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:01.414944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:01.415381 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:01.424543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:02.017037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:02.017662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:02.025959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:02.026464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:02.026913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:02.032115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:02.032606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:02.033437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:02.228817 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:02.236961 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4f211d65-3a1f-4673-83f1-8e43475af5b4 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.863460 Aug 10 10:06:02.252963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 210/418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:01 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:02.377055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:02.391042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-62330b90-7889-4c26-af49-e20f9c5d5183 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.380577 Aug 10 10:06:02.392647 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 209/419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:02 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:02.819746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-40e04eb2-3769-4cf8-a952-14ba39f112e7 req-743a5643-cb49-4a6f-9cc7-1a961423fbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3acf77a6-2970-4d9a-aee8-46e37fe3a0bb", "tag": "72577d9b-8949-4110-8e7a-5678ee2987d0"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:02.844964 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-40e04eb2-3769-4cf8-a952-14ba39f112e7 req-743a5643-cb49-4a6f-9cc7-1a961423fbaa service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:02.848835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-40e04eb2-3769-4cf8-a952-14ba39f112e7 req-743a5643-cb49-4a6f-9cc7-1a961423fbaa service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:02.850443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-40e04eb2-3769-4cf8-a952-14ba39f112e7 req-743a5643-cb49-4a6f-9cc7-1a961423fbaa service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:02.891746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-40e04eb2-3769-4cf8-a952-14ba39f112e7 req-743a5643-cb49-4a6f-9cc7-1a961423fbaa service nova] Creating event network-changed:72577d9b-8949-4110-8e7a-5678ee2987d0 for instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb on hv-cinder-85083 Aug 10 10:06:02.906457 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-40e04eb2-3769-4cf8-a952-14ba39f112e7 req-743a5643-cb49-4a6f-9cc7-1a961423fbaa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091370 Aug 10 10:06:02.909898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 211/420] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:03.266806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:03.267461 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:03.285332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:03.286143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:03.286919 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:03.287902 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:03.289398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:03.292740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:03.413854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:03.414595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:03.425337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=82 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:03.428405 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:03.429117 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:03.429727 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:03.431353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:03.432022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:03.432787 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:03.645592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:03.654325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1e288a6b-2cc2-4610-9a2a-2a901443c12f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.391830 Aug 10 10:06:03.659210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 210/421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:03 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:03.854679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:03.865503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-20e15e82-9138-4f87-b0ee-f4d82318f985 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.455346 Aug 10 10:06:03.867623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 212/422] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:03 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:04.681791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:04.683301 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:04.695852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:04.701313 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:04.702915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:04.703770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:04.704241 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:04.704682 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:04.891715 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:04.893052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:04.904801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:04.909168 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:04.909808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:04.910732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:04.911386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:04.911970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:05.306847 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:05.324615 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fa03aef5-5bf3-402d-8a58-6f7abd9efc01 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.647781 Aug 10 10:06:05.326998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 211/423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:04 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:05.330209 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-94ec6922-7f0f-4235-a27d-3177b2003afe req-4046b6ed-c438-46fc-af82-0aeea35982e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c63d7ad-f726-40c4-81d9-b7be9492211b", "tag": "887e207d-4c97-4327-ac8a-a5e5d6d83824"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:05.355757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-94ec6922-7f0f-4235-a27d-3177b2003afe req-4046b6ed-c438-46fc-af82-0aeea35982e6 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:05.356219 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-94ec6922-7f0f-4235-a27d-3177b2003afe req-4046b6ed-c438-46fc-af82-0aeea35982e6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:05.356850 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-94ec6922-7f0f-4235-a27d-3177b2003afe req-4046b6ed-c438-46fc-af82-0aeea35982e6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:05.369206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-94ec6922-7f0f-4235-a27d-3177b2003afe req-4046b6ed-c438-46fc-af82-0aeea35982e6 service nova] Creating event network-changed:887e207d-4c97-4327-ac8a-a5e5d6d83824 for instance 3c63d7ad-f726-40c4-81d9-b7be9492211b on hv-cinder-85083 Aug 10 10:06:05.377666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:05.378104 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-94ec6922-7f0f-4235-a27d-3177b2003afe req-4046b6ed-c438-46fc-af82-0aeea35982e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051255 Aug 10 10:06:05.378722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 212/424] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:05.387505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ac942231-205c-4fd4-ae33-93e726c11dac tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.499710 Aug 10 10:06:05.391578 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 213/425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:04 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:06.063891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-779934427"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:06.064293 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:06.077661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:06.078182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:06.078615 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:06.082278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:06.082771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:06.083247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:06.345775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:06.346410 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:06.359275 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:06.359996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:06.360644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:06.361801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:06.363047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:06.367183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:06.388493 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.network.security_group_api [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Adding security group 3c7f33b9-58ca-4b46-bcd2-03efa08b5102 to port 72577d9b-8949-4110-8e7a-5678ee2987d0 Aug 10 10:06:06.703324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:06.711352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-65bd7bcf-f3ac-493d-aedf-629665c0fc24 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.369346 Aug 10 10:06:06.712195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 214/426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:06 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:06.718897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:06.720131 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:06.727363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:06.728562 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:06.729013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:06.729734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:06.730400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:06.730840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:07.015714 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:07.028435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-518d1394-7c07-4a72-87e6-39e1ac54bbec tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.314997 Aug 10 10:06:07.029135 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 215/427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:06 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:07.210064 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f78fb384-ed35-4788-af8e-c380558bdb19 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/action" status: 202 len: 0 microversion: 2.1 time: 1.150910 Aug 10 10:06:07.210943 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 213/428] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:06:06 2022] POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/action => generated 0 bytes in 1153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:06:07.223918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d249dd7e-2587-4036-99c4-f71eb67a3e8e req-5dc87181-fd89-4604-ac43-a010d8b73eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3acf77a6-2970-4d9a-aee8-46e37fe3a0bb", "tag": "72577d9b-8949-4110-8e7a-5678ee2987d0"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:07.226219 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:07.226840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:07.242049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:07.242049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:07.242872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:07.243337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:07.249601 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:07.250405 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:07.255290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d249dd7e-2587-4036-99c4-f71eb67a3e8e req-5dc87181-fd89-4604-ac43-a010d8b73eae service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:07.256047 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d249dd7e-2587-4036-99c4-f71eb67a3e8e req-5dc87181-fd89-4604-ac43-a010d8b73eae service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:07.256669 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d249dd7e-2587-4036-99c4-f71eb67a3e8e req-5dc87181-fd89-4604-ac43-a010d8b73eae service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:07.282436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d249dd7e-2587-4036-99c4-f71eb67a3e8e req-5dc87181-fd89-4604-ac43-a010d8b73eae service nova] Creating event network-changed:72577d9b-8949-4110-8e7a-5678ee2987d0 for instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb on hv-cinder-85083 Aug 10 10:06:07.288007 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-d249dd7e-2587-4036-99c4-f71eb67a3e8e req-5dc87181-fd89-4604-ac43-a010d8b73eae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067944 Aug 10 10:06:07.289222 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 214/429] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:07.570645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-ab61806c-86eb-4e45-b0c1-78873f2ca81a req-7b496518-11bf-4f5f-aa66-f84f111ad09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e9b1f3-3de1-47c6-8789-c37b4c5c8542", "name": "network-vif-plugged", "status": "completed", "tag": "69ed488f-c5fd-4bfe-942f-80603f3e88ae"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:07.593140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-ab61806c-86eb-4e45-b0c1-78873f2ca81a req-7b496518-11bf-4f5f-aa66-f84f111ad09a service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:07.597453 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-ab61806c-86eb-4e45-b0c1-78873f2ca81a req-7b496518-11bf-4f5f-aa66-f84f111ad09a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:07.598062 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-ab61806c-86eb-4e45-b0c1-78873f2ca81a req-7b496518-11bf-4f5f-aa66-f84f111ad09a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:07.621122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:07.629948 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ceedc653-9fbf-470b-a0b0-de590e42ae14 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1759 microversion: 2.1 time: 0.414262 Aug 10 10:06:07.634339 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-ab61806c-86eb-4e45-b0c1-78873f2ca81a req-7b496518-11bf-4f5f-aa66-f84f111ad09a service nova] Creating event network-vif-plugged:69ed488f-c5fd-4bfe-942f-80603f3e88ae for instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 on hv-cinder-85083 Aug 10 10:06:07.635256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 216/430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:07 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1759 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:07.660206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-ab61806c-86eb-4e45-b0c1-78873f2ca81a req-7b496518-11bf-4f5f-aa66-f84f111ad09a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093315 Aug 10 10:06:07.661249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 215/431] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:06:07.736970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:07.737948 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:07.763804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:07.764573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:07.765190 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:07.766844 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:07.770348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:07.773206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:07.941395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=4 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:08.047874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:08.049274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=16 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:08.054592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:08.055479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:08.065455 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:08.074433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:08.076275 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:08.076948 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:08.078079 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:08.078198 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1a10c6fb-9d2a-46b0-bc1f-052bd6e25f47 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.346631 Aug 10 10:06:08.078708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 217/432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:07 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:08.079148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:08.079813 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:08.393378 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:08.420399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-67b13849-62e8-4e6b-94c0-22006fdb128c tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.373937 Aug 10 10:06:08.436154 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 216/433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:08 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:08.549135 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-046d9752-12e5-43de-a9a3-75c4951bc45e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Action: 'create', calling method: .version_select at 0x7f22fbfec1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-329800085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwfVYEmlH1nSdS1nXfuL23J8xvD5eSY+Oqq3pLxzsf7sUKMPUk+PN51cad2GqxWHFB4fr1POuG9tJgAITVvyu+PCyLuy8+cploNaVmWQt0kYdrPGmLSM583bz9+yaYauQ=="}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:08.564950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-046d9752-12e5-43de-a9a3-75c4951bc45e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:06:08.569020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-046d9752-12e5-43de-a9a3-75c4951bc45e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for user 7a9c654fc9bc4ad4b530d3f4df5c24c8 and project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:06:08.592989 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-046d9752-12e5-43de-a9a3-75c4951bc45e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.292778 Aug 10 10:06:08.594258 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 218/434] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:06:08 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:06:09.098870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:09.099581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:09.105956 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:09.106681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:09.107358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:09.108226 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:09.108857 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:09.109303 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:09.270797 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:09.286342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-88e6bf43-21fc-42f2-be65-e89cd2512409 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.191320 Aug 10 10:06:09.286941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 217/435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:09 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:09.443941 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:09.445193 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:09.453759 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:09.454259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:09.454705 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:09.455545 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:09.456013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:09.456449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:09.637485 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:09.645911 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4f65cd62-6ef6-4a27-b25a-3825b961da09 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1318 microversion: 2.1 time: 0.206162 Aug 10 10:06:09.646569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 219/436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:09 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:10.059665 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-24b79b96-9035-45d0-84ad-d7eadac6198f req-4bf3bd5e-c1cc-41ff-a773-2b7c57ac7529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c63d7ad-f726-40c4-81d9-b7be9492211b", "name": "network-vif-plugged", "status": "completed", "tag": "887e207d-4c97-4327-ac8a-a5e5d6d83824"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:10.083191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-24b79b96-9035-45d0-84ad-d7eadac6198f req-4bf3bd5e-c1cc-41ff-a773-2b7c57ac7529 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:10.084722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-24b79b96-9035-45d0-84ad-d7eadac6198f req-4bf3bd5e-c1cc-41ff-a773-2b7c57ac7529 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:10.086306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-24b79b96-9035-45d0-84ad-d7eadac6198f req-4bf3bd5e-c1cc-41ff-a773-2b7c57ac7529 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:10.130454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-24b79b96-9035-45d0-84ad-d7eadac6198f req-4bf3bd5e-c1cc-41ff-a773-2b7c57ac7529 service nova] Creating event network-vif-plugged:887e207d-4c97-4327-ac8a-a5e5d6d83824 for instance 3c63d7ad-f726-40c4-81d9-b7be9492211b on hv-cinder-85083 Aug 10 10:06:10.151724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-24b79b96-9035-45d0-84ad-d7eadac6198f req-4bf3bd5e-c1cc-41ff-a773-2b7c57ac7529 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096198 Aug 10 10:06:10.156246 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 218/437] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:10.308222 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:10.309767 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:10.317140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:10.317640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:10.318085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:10.318791 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:10.319441 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:10.320026 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:10.505647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:10.513729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a50c3f48-7e0f-4ab8-9c90-8d3372a2748c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.210279 Aug 10 10:06:10.517803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 220/438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:10 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:10.669026 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:10.669733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:10.676299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:10.676797 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:10.677244 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:10.677957 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:10.678591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:10.679055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:10.831531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:10.839514 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5fefcf19-e111-4490-a4b3-d0d354c4f46d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1506 microversion: 2.1 time: 0.175197 Aug 10 10:06:10.840097 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 219/439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:10 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:10.860334 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac3ce790-8455-454c-bac5-57d2cf675518", "device": "/dev/sdb"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:10.863051 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:10.873997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:10.874757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:10.875296 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:10.876267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:10.876732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:10.877161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:11.136451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1bac734c-5196-4bd9-a5d2-0e4d8f7d8c89 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "POST /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280187 Aug 10 10:06:11.137164 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 221/440] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:06:10 2022] POST /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:11.535671 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:11.536280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:11.543360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:11.543847 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:11.544291 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:11.544981 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:11.545441 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:11.545871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:11.689708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:11.697707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-837320d0-af3b-4e5d-b552-55a7eaab0799 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1370 microversion: 2.1 time: 0.165860 Aug 10 10:06:11.698453 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 220/441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:11 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:12.720387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:12.721035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:12.727253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:12.728257 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:12.728697 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:12.729388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:12.729847 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:12.730275 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:12.871131 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:12.880213 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-339e7052-150e-4da1-b533-bdd1835fdb65 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1564 microversion: 2.1 time: 0.164516 Aug 10 10:06:12.880807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 222/442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:12 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:12.902394 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:12.902978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:12.909382 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:12.909866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:12.910308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:12.911017 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:12.911526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:12.911955 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:12.995306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ada0f46c-f170-4d9f-a3bf-df836a264524 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097290 Aug 10 10:06:12.995944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 221/443] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:06:12 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:14.192032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-b0a4cbfc-e2b9-410e-97c3-0923479704ce req-4fde052c-2cf8-43cf-b846-bc321e43d013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c63d7ad-f726-40c4-81d9-b7be9492211b", "tag": "887e207d-4c97-4327-ac8a-a5e5d6d83824"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:14.204962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-b0a4cbfc-e2b9-410e-97c3-0923479704ce req-4fde052c-2cf8-43cf-b846-bc321e43d013 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:14.205440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-b0a4cbfc-e2b9-410e-97c3-0923479704ce req-4fde052c-2cf8-43cf-b846-bc321e43d013 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:14.205872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-b0a4cbfc-e2b9-410e-97c3-0923479704ce req-4fde052c-2cf8-43cf-b846-bc321e43d013 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:14.218778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-b0a4cbfc-e2b9-410e-97c3-0923479704ce req-4fde052c-2cf8-43cf-b846-bc321e43d013 service nova] Creating event network-changed:887e207d-4c97-4327-ac8a-a5e5d6d83824 for instance 3c63d7ad-f726-40c4-81d9-b7be9492211b on hv-cinder-85083 Aug 10 10:06:14.223499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-b0a4cbfc-e2b9-410e-97c3-0923479704ce req-4fde052c-2cf8-43cf-b846-bc321e43d013 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039072 Aug 10 10:06:14.224102 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 223/444] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:26.910099 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:26.911183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=64 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:26.917185 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:26.917746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:26.924783 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:26.925268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:26.925704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:26.926397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:26.926884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:26.927433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:26.952268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f0f60a73-1711-4f8a-ba37-cf5e74a27a19 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/ips" status: 200 len: 152 microversion: 2.20 time: 0.043781 Aug 10 10:06:26.953140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 222/445] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 10 10:06:26 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:06:30.336468 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=4 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:30.337436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:30.338091 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:30.342233 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1720042789", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-329800085", "security_groups": [{"name": "tempest-secgroup-smoke-232252562"}], "block_device_mapping_v2": [{"uuid": "8d961944-1b96-47de-8106-c606c36dd553", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65312932-d264-4229-974f-272fdfb7e5f8"}]}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:30.458398 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.network.neutron [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] validate_networks() for [('65312932-d264-4229-974f-272fdfb7e5f8', None, None, None, None, None)] {{(pid=117895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:06:30.510628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:30.511260 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:30.517578 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:30.518308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:30.518752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:30.519517 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:30.519982 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:30.520417 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:30.544744 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lazy-loading 'flavor' on Instance uuid bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:06:30.731329 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9a606cd3-b70d-42ac-aa46-c72951ac86ff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/action" status: 202 len: 0 microversion: 2.20 time: 0.224999 Aug 10 10:06:30.731932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 223/446] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 10 10:06:30 2022] POST /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 10:06:30.740539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:30.741231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:30.748113 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:30.748602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:30.749036 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:30.749895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:30.750510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:30.751233 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:30.900847 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Flavor limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:06:30.901350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Image limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:06:30.901916 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Flavor pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:06:30.902390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Image pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:06:30.902873 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:06:30.912216 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:30.912697 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:30.913153 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:30.913970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:30.914929 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:30.915380 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:30.922415 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:30.931706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:30.933128 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:06:30.933253 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:30.934373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bcdbb40c-2563-4bcc-bbe8-5da5b031b286 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.197979 Aug 10 10:06:30.935151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 224/447] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:30 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:30.939872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for user 7a9c654fc9bc4ad4b530d3f4df5c24c8 and project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:06:30.995877 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Going to run 1 instances... {{(pid=117895) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:06:30.998042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d961944-1b96-47de-8106-c606c36dd553',volume_size=None,volume_type=None)] {{(pid=117895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:06:31.125099 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-008714fd-2871-48a1-a640-97ac3de2b0dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.790053 Aug 10 10:06:31.125998 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 224/448] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:06:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:06:31.136815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b46d7882-7a2a-4f84-a0ba-383383cd6fca tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:31.137435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b46d7882-7a2a-4f84-a0ba-383383cd6fca tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:31.193393 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b46d7882-7a2a-4f84-a0ba-383383cd6fca tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:31.200181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b46d7882-7a2a-4f84-a0ba-383383cd6fca tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1094 microversion: 2.1 time: 0.067158 Aug 10 10:06:31.200936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 225/449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:31 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:31.619112 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:31.619611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:31.626835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:31.627344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:31.627785 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:31.628564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:31.628923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:31.629347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:31.753678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lazy-loading 'services' on Instance uuid 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:06:31.862821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ba8f6a42-ad95-4662-bfbd-a5790eb91c2e tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542/os-volume_attachments/ac3ce790-8455-454c-bac5-57d2cf675518" status: 202 len: 0 microversion: 2.1 time: 0.248125 Aug 10 10:06:31.863457 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 225/450] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:06:31 2022] DELETE /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542/os-volume_attachments/ac3ce790-8455-454c-bac5-57d2cf675518 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:06:31.957110 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:31.957662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:31.964686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:31.965172 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:31.965612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:31.966306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:31.966765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:31.967220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:32.094044 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:32.104509 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:32.106643 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:32.108082 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-62cb855f-bda1-49fe-b8c5-6ff8da96ebd1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.154935 Aug 10 10:06:32.108829 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 226/451] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:31 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:32.221825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:32.222466 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:32.229034 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:32.229515 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:32.229956 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:32.230774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:32.231153 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:32.231616 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:32.293155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:32.300416 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dc9157f5-189a-49d2-b54f-e926278f3467 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1200 microversion: 2.1 time: 0.082944 Aug 10 10:06:32.300973 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 226/452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:32 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1200 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:33.131222 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:33.132058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:33.138890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:33.139406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:33.139933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:33.140672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:33.141051 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:33.141885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:33.281258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:33.289139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:33.291251 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:33.292401 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-492ca68b-e420-4437-83d9-ffd8bf8f7b07 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.165291 Aug 10 10:06:33.292959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 227/453] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:33 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:33.322275 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:33.322892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:33.329110 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:33.329619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:33.330055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:33.330748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:33.331232 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:33.331654 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:33.487203 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:33.500502 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-694b12d7-c538-443a-8dc7-86a105a2d8a6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1277 microversion: 2.1 time: 0.181652 Aug 10 10:06:33.501649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 227/454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:33 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:34.044342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:34.044849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:34.049474 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-4cf6ed3a-b528-4765-adb8-a1658af8f160 req-d165125c-5077-4b2f-a833-d422a444662b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479fd26a-e2a8-4d55-a760-afbc7de61715", "tag": "94e22129-7a42-4420-8f52-51b45bb6fffc"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:34.050875 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.051402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.051847 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.052547 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.053009 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.053439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.065924 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4cf6ed3a-b528-4765-adb8-a1658af8f160 req-d165125c-5077-4b2f-a833-d422a444662b service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.066661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4cf6ed3a-b528-4765-adb8-a1658af8f160 req-d165125c-5077-4b2f-a833-d422a444662b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.068063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4cf6ed3a-b528-4765-adb8-a1658af8f160 req-d165125c-5077-4b2f-a833-d422a444662b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.084286 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-4cf6ed3a-b528-4765-adb8-a1658af8f160 req-d165125c-5077-4b2f-a833-d422a444662b service nova] Creating event network-changed:94e22129-7a42-4420-8f52-51b45bb6fffc for instance 479fd26a-e2a8-4d55-a760-afbc7de61715 on hv-cinder-85083 Aug 10 10:06:34.086899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:06:34.092120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-4cf6ed3a-b528-4765-adb8-a1658af8f160 req-d165125c-5077-4b2f-a833-d422a444662b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046180 Aug 10 10:06:34.092876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 228/455] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:34.170387 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-130e203e-7418-4e52-aef8-a317dd72517d tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "DELETE /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 204 len: 0 microversion: 2.1 time: 0.129742 Aug 10 10:06:34.171073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 228/456] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:06:34 2022] DELETE /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:06:34.180421 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:34.181198 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:34.187387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.187875 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.188318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.189014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.189471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.189897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.315421 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:34.316154 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:34.322426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:34.322973 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.323075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.323508 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.324218 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.324908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.325350 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.330341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c5caa22c-2c75-4896-aad7-799ec53a82e9 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1512 microversion: 2.1 time: 0.154438 Aug 10 10:06:34.330908 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 229/457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:34 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:34.456318 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:34.464827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:34.466334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:34.467526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-68ed2559-3044-4797-8d16-cfef845db591 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.156410 Aug 10 10:06:34.468084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 229/458] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:34 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:34.521987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:34.522595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:34.529265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.529761 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.530205 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.530906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:34.531394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:34.531867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:34.659065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:34.666595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-699f5c6b-a887-42ac-b152-03d15dd7b051 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.148375 Aug 10 10:06:34.667475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 230/459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:34 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:35.352044 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:35.352663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:35.359074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:35.359691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:35.360136 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:35.360829 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:35.361288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:35.361719 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:35.490074 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:35.490695 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:35.491137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:35.497746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:35.498244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:35.498686 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:35.499321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ac83298c-90a5-4b94-a845-0850fe9c67dc tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1512 microversion: 2.1 time: 0.151043 Aug 10 10:06:35.499487 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:35.499861 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:35.500005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 230/460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:35 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:35.500378 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:35.632560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:35.640930 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:35.642435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:35.643648 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-523defe8-edb7-44fd-8e27-070809570b94 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.157486 Aug 10 10:06:35.644214 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 231/461] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:35 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:35.686908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:35.687560 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:35.693442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:35.693927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:35.694363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:35.695077 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:35.696163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:35.696593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:35.827564 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:35.834849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1cb4fba7-59bc-4514-9c8c-5724216375c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.151678 Aug 10 10:06:35.835442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 231/462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:35 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:36.521350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:36.521962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:36.528764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:36.529246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:36.529683 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:36.530365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:36.530820 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:36.531279 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:36.656084 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:36.664744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0ef2c49b-ee4b-4473-8605-a980989ac109 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1512 microversion: 2.1 time: 0.146719 Aug 10 10:06:36.665504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 232/463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:36 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:36.666123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:36.667390 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:36.675595 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:36.676227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:36.676685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:36.677641 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:36.678411 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:36.678947 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:36.811901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:36.819970 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:36.821492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:36.822650 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b0dbd5ed-f69c-4293-8042-6ca99471bf27 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.160953 Aug 10 10:06:36.823263 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 232/464] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:36 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:36.855854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:36.856638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:36.862518 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:36.863108 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:36.863635 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:36.864324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:36.864780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:36.865207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:36.996575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:37.004296 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-399f7a06-3421-4ddd-a3aa-52e9ad6dbbd5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.152730 Aug 10 10:06:37.004940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 233/465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:36 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:37.611258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d2bfa61e-9f24-47f6-8a41-f8f36f68fb76 req-eb1a6c40-c4c1-4668-977e-f06eb83e245d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e9b1f3-3de1-47c6-8789-c37b4c5c8542", "name": "network-vif-deleted", "tag": "69ed488f-c5fd-4bfe-942f-80603f3e88ae"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:37.623340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d2bfa61e-9f24-47f6-8a41-f8f36f68fb76 req-eb1a6c40-c4c1-4668-977e-f06eb83e245d service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:37.624168 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d2bfa61e-9f24-47f6-8a41-f8f36f68fb76 req-eb1a6c40-c4c1-4668-977e-f06eb83e245d service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:37.624617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d2bfa61e-9f24-47f6-8a41-f8f36f68fb76 req-eb1a6c40-c4c1-4668-977e-f06eb83e245d service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:37.640816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d2bfa61e-9f24-47f6-8a41-f8f36f68fb76 req-eb1a6c40-c4c1-4668-977e-f06eb83e245d service nova] Creating event network-vif-deleted:69ed488f-c5fd-4bfe-942f-80603f3e88ae for instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 on hv-cinder-85083 Aug 10 10:06:37.646006 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-d2bfa61e-9f24-47f6-8a41-f8f36f68fb76 req-eb1a6c40-c4c1-4668-977e-f06eb83e245d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038120 Aug 10 10:06:37.647031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 233/466] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:37.687680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:37.688308 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:37.695093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:37.695623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:37.696086 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:37.696769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:37.697233 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:37.697667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:37.733208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:37.733705 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:37.734241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:37.735274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lazy-loading 'fault' on Instance uuid 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:06:37.777209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55ae4dbafed74e9dbeab9538898cf1f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c42b50ff98c40a6b2f47f289538a330', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:37.784703 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e2b95b7a-9b3a-4947-9f08-49ff67c76340 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 200 len: 1308 microversion: 2.1 time: 0.101466 Aug 10 10:06:37.785263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 234/467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:37 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:37.845882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:37.846478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:37.853556 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:37.854038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:37.854475 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:37.855201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:37.855659 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:37.856084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:37.989483 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:37.997766 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:37.999296 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:38.000443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-19b860a3-d513-4531-a1e0-6ebc0d8b4b31 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.158872 Aug 10 10:06:38.001268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 234/468] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:37 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:38.025862 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:38.026468 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:38.032253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:38.032736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:38.033177 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:38.033864 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:38.034320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:38.034781 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:38.168007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:38.175396 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-61db516d-8bda-4634-a0e5-5d8e7b7a4111 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.154377 Aug 10 10:06:38.175962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 235/469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:38 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:38.806259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:38.806871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] [instance: 10e9b1f3-3de1-47c6-8789-c37b4c5c8542] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:38.812755 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:38.813238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:38.813677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:38.814360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:38.814811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:38.815262 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:38.828977 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] HTTP exception thrown: Instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 could not be found. Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Request method failure captured: Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 HTTP/1.1 Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84KXMjPvygi5F_kggw09VZkLFBAp6FdqJhUGBRqOSDlYIV3XcB71a6mGF8r2EtOAKYbZJSfWtCXpp2YaVQUnplGrmBXGdlQ3IpZA08gB5TaJpIs513QBz318Aj-qngq_ESZn1TTi1QJOwa2FyOlyOvWa21W6zURRuxhBbJFzl9qlIfI Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 0c42b50ff98c40a6b2f47f289538a330 Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1937306643 Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:06:38.830599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0c42b50ff98c40a6b2f47f289538a330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c42b50ff98c40a6b2f47f289538a330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0c42b50ff98c40a6b2f47f289538a330"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0c42b50ff98c40a6b2f47f289538a330"}]}] Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesSnapshotTestJSON-1937306643 Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 0c42b50ff98c40a6b2f47f289538a330 Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1937306643 Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesSnapshotTestJSON-1937306643-project Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 55ae4dbafed74e9dbeab9538898cf1f6 Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesSnapshotTestJSON-1937306643-project Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 could not be found. Aug 10 10:06:38.832217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '10e9b1f3-3de1-47c6-8789-c37b4c5c8542'} Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 could not be found. Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:06:38.833042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 could not be found. Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 could not be found. Aug 10 10:06:38.834234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:06:38.835397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] Returning 404 to user: Instance 10e9b1f3-3de1-47c6-8789-c37b4c5c8542 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:06:38.835397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4014c00f-f058-4fef-97d9-d96e30f8f642 tempest-VolumesSnapshotTestJSON-1937306643 tempest-VolumesSnapshotTestJSON-1937306643-project] 10.222.0.20 "GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542" status: 404 len: 111 microversion: 2.1 time: 0.030119 Aug 10 10:06:38.835397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 235/470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:38 2022] GET /compute/v2.1/servers/10e9b1f3-3de1-47c6-8789-c37b4c5c8542 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:06:39.024524 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:39.025144 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:39.031270 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:39.031801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:39.032192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:39.032889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:39.033352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:39.033909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:39.170755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:39.178579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:39.180649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:39.181806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5ad2deee-07b7-442b-8068-f36243cdd011 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.161773 Aug 10 10:06:39.182368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 236/471] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:39 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:39.198266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:39.198911 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:39.205123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:39.205602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:39.206036 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:39.206750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:39.207234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:39.207661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:39.346845 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:39.354187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c0e100d3-bc19-4006-81a2-8c1b5a970965 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.160589 Aug 10 10:06:39.354747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 236/472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:39 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:40.205127 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:40.205745 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:40.212035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:40.212526 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:40.212990 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:40.213724 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:40.214193 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:40.214679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:40.359768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:40.368325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:40.369854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:40.371026 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-734157cc-1cb1-41cf-9739-b64071199c02 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.169726 Aug 10 10:06:40.371581 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 237/473] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:40 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:40.374371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:40.375075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:40.381810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:40.382298 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:40.382890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:40.383621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:40.384081 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:40.384513 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:40.402058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:40.517517 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:40.525502 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1bef911c-45af-49e4-b0c1-56fed231b605 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.155178 Aug 10 10:06:40.526063 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 237/474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:40 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:41.393882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:41.394533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:41.396617 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:41.397432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=6 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:41.404317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:41.404812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:41.405260 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:41.406023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:41.406490 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:41.406925 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:41.536322 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:41.544257 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:41.545810 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:41.545955 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:41.546915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:41.547053 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4afb5579-3376-4496-8528-955b78d6c43c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.157063 Aug 10 10:06:41.547560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 238/475] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:41 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:41.548878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:41.555328 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:41.555824 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:41.556271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:41.556980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:41.557445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:41.557877 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:41.687858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:41.695264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a3f9fb91-cb00-44ec-b3f3-a5545c7e7297 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.153568 Aug 10 10:06:41.696404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 238/476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:41 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:42.570996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:42.571638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:42.578025 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:42.578515 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:42.578978 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:42.579767 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:42.580230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:42.580659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:42.708350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:42.716278 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:42.716435 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:42.716918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:42.717802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:42.718985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-767bbd31-3642-409c-8794-4724ab58a770 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.152562 Aug 10 10:06:42.719540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 239/477] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:42 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:42.723481 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:42.723980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:42.724429 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:42.725165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:42.725655 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:42.726114 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:42.854842 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:42.862303 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4d0c7815-a99a-4ef9-8733-9415822adf53 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.149829 Aug 10 10:06:42.862870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 239/478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:42 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:43.741632 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:43.743393 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:43.749771 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:43.750288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:43.751031 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:43.751763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:43.752228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:43.752663 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:43.882696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:43.883929 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:43.884407 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:43.887778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:43.890723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:43.891249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:43.891728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:43.892438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:43.892834 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:43.892965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:43.893318 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:43.894363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:43.895569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7559c8cc-a538-4166-b71e-4d11058e4fa1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.157841 Aug 10 10:06:43.896288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 240/479] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:43 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:44.021865 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:44.029728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-59d72592-5b6c-4d5b-abbe-8ea1c7a4a004 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.151055 Aug 10 10:06:44.030330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 240/480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:43 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:44.918789 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:44.919369 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:44.926224 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:44.926708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:44.927184 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:44.927872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:44.928328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:44.928757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:45.050591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:45.051309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:45.058286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:45.058789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:45.058891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:45.059261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:45.059970 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:45.060430 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:45.060867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:45.066630 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:45.068180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:45.069331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ac45c359-1aa4-4508-b32a-0a7fbd6b5b1c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.154486 Aug 10 10:06:45.070184 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 241/481] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:44 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:45.191757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:45.199385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c7df9268-d9b2-438a-8598-f88a98ac9243 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.152888 Aug 10 10:06:45.199953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 241/482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:45 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:46.092718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:46.093330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:46.099670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:46.100398 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:46.101020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:46.101717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:46.102177 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:46.102780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:46.221714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:46.222940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:46.236437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:46.236936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:46.237377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:46.238259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:46.238723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:46.239210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:46.239655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:46.251162 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:46.252668 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:46.254013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0b99945a-1172-4c1a-b434-4702cd2914b1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.165405 Aug 10 10:06:46.254567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 242/483] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:46 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:46.370002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:46.377738 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-87e63d55-8cf2-445d-96ae-e559287a316e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.159853 Aug 10 10:06:46.378309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 242/484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:46 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:47.278771 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:47.279241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:47.285872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:47.286362 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:47.286810 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:47.287539 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:47.288003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:47.288435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:47.399338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:47.399959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:47.406358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:47.406849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:47.407507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:47.408213 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:47.408672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:47.409100 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:47.422140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:47.430518 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:47.432054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:47.433205 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0256c3a6-2c86-4370-9e53-87ad1125188b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.159400 Aug 10 10:06:47.433763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 243/485] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:47 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:47.542232 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:47.550285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-260e8aca-9878-4ce0-905b-07fdcda56995 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.155774 Aug 10 10:06:47.550860 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 243/486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:47 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:48.135784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-4337bcd1-924d-4f36-a6c0-f0d35fc95a41 req-c3edb8f1-14c3-4ff8-a957-65f531ee3c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479fd26a-e2a8-4d55-a760-afbc7de61715", "name": "network-vif-plugged", "status": "completed", "tag": "94e22129-7a42-4420-8f52-51b45bb6fffc"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:48.145660 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4337bcd1-924d-4f36-a6c0-f0d35fc95a41 req-c3edb8f1-14c3-4ff8-a957-65f531ee3c74 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:48.146159 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4337bcd1-924d-4f36-a6c0-f0d35fc95a41 req-c3edb8f1-14c3-4ff8-a957-65f531ee3c74 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:48.146593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4337bcd1-924d-4f36-a6c0-f0d35fc95a41 req-c3edb8f1-14c3-4ff8-a957-65f531ee3c74 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:48.158252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-4337bcd1-924d-4f36-a6c0-f0d35fc95a41 req-c3edb8f1-14c3-4ff8-a957-65f531ee3c74 service nova] Creating event network-vif-plugged:94e22129-7a42-4420-8f52-51b45bb6fffc for instance 479fd26a-e2a8-4d55-a760-afbc7de61715 on hv-cinder-85083 Aug 10 10:06:48.163226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-4337bcd1-924d-4f36-a6c0-f0d35fc95a41 req-c3edb8f1-14c3-4ff8-a957-65f531ee3c74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031573 Aug 10 10:06:48.163938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 244/487] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:48.458559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:48.459291 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:48.466169 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:48.466740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:48.467359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:48.468163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:48.469189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:48.469635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:48.573542 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:48.574250 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:48.580598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:48.581089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:48.581564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:48.582264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:48.582724 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:48.583180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:48.600411 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:48.608878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:48.610381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:48.611566 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6d2bc2f2-d60f-45f3-a4eb-b194975b6625 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.158466 Aug 10 10:06:48.612128 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 244/488] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:48 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:48.714732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:48.722128 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-04ff1c49-4eaa-4a09-8987-acad530692c7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.154440 Aug 10 10:06:48.722695 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 245/489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:48 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:49.635321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:49.635934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:49.642289 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:49.642774 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:49.643247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:49.643939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:49.644398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:49.644828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:49.743536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:49.744148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:49.750529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:49.751343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:49.751776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:49.752468 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:49.752924 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:49.753352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:49.770506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:49.778336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:49.779870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:49.781028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fbdbe48b-07cf-4497-a6bc-a1e44a0f0981 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.150148 Aug 10 10:06:49.781581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 245/490] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:49 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:49.880506 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:49.888446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e43a17d5-fda6-4d5e-bc7c-4c76f95b346d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.149282 Aug 10 10:06:49.889007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 246/491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:49 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:50.488253 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:50.488750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:50.495161 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.495645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.496080 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.496763 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.497377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.497638 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.520640 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b3ea69bc-ab15-4eb9-9604-eabbe089e65b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0/ips" status: 200 len: 149 microversion: 2.1 time: 0.036232 Aug 10 10:06:50.521199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 246/492] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:06:50 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:50.532272 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:50.534627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:50.540531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.541048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.541495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.542189 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.542655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.543120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.621321 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Invalid volume: volume 28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9 is already attached to instances: 50513b4b-53a2-4825-821b-07ff035fe17c Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: POST /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0/os-volume_attachments HTTP/1.1 Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 74 Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:06:50.623081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {"volumeAttachment": {"volumeId": "28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9"}} Aug 10 10:06:50.624641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Invalid volume: volume 28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9 is already attached to instances: 50513b4b-53a2-4825-821b-07ff035fe17c Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'server_id': '14284420-f1ed-4de0-a217-90e8b43f96a0', 'body': {'volumeAttachment': {'volumeId': '28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9'}}} Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9 is already attached to instances: 50513b4b-53a2-4825-821b-07ff035fe17c Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:50.625828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9 is already attached to instances: 50513b4b-53a2-4825-821b-07ff035fe17c Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:50.627268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9 is already attached to instances: 50513b4b-53a2-4825-821b-07ff035fe17c Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 400 to user: Invalid volume: volume 28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9 is already attached to instances: 50513b4b-53a2-4825-821b-07ff035fe17c {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c98d5c32-916b-4942-8402-720faa862e51 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096241 Aug 10 10:06:50.628661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 247/493] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:06:50 2022] POST /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:06:50.634981 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:50.635498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:50.641565 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.642050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.642490 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.643257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.643717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.644148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.668196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:06:50.741885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e0b4452e-a6f6-4541-b4af-6af1abdb628a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 204 len: 0 microversion: 2.1 time: 0.111136 Aug 10 10:06:50.743202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 247/494] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:06:50 2022] DELETE /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:06:50.751717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:50.752335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:50.761762 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.762251 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.762692 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.763425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.763889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.764320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.804917 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:50.805631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:50.811489 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.811978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.812422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.813116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.813575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.814003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.948484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:50.955982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-254a721a-aeb1-4d6d-8aa0-957c24ebf3f2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1680 microversion: 2.1 time: 0.208334 Aug 10 10:06:50.956541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 248/495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:50 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:06:50.961617 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:50.962228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:50.967882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.968660 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.968820 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.969543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:50.969995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:50.970422 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:50.978380 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:50.986461 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:50.988013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:50.989181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0b0c7e58-4bd9-475e-a3fb-1256bf99e49e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.189042 Aug 10 10:06:50.989742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 248/496] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:50 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:51.101647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:51.108977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0149ad3e-8ec3-44af-a877-4962103e7aa3 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.151500 Aug 10 10:06:51.109542 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 249/497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:50 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:51.978812 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:51.979454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:51.985591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:51.986121 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:51.986541 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:51.987262 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:51.988036 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:51.988646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:52.012199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:52.012812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:52.019279 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:52.019767 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:52.020210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:52.020909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:52.021366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:52.021791 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:52.166840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:52.174283 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8330ab4f-bd1b-4ebc-ae75-25f357d4b011 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1680 microversion: 2.1 time: 0.200169 Aug 10 10:06:52.174854 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 249/498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:51 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:52.179347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:52.179962 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:52.186072 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:52.186294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:52.186739 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:52.187460 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:52.187921 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:52.188354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:52.195640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:52.203558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:52.205077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:52.206239 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-091d8d98-f986-4c98-a699-0ba4f4ed6137 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.197992 Aug 10 10:06:52.206990 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 250/499] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:52 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:52.322901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:52.330197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-98e6ccc2-4dcc-484d-95c1-ea39f882b27e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.154384 Aug 10 10:06:52.330794 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 250/500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:52 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:52.920317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:52.922698 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:52.928797 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:52.929280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:52.929719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:52.930417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:52.930874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:52.931335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.001464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d0686351-2ef6-4423-9e4f-f13148dd7187 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/action" status: 202 len: 0 microversion: 2.1 time: 0.084791 Aug 10 10:06:53.002183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 251/501] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:06:52 2022] POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:06:53.009977 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:53.010592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:53.016954 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.017436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.017869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.018557 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.019035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.019463 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.162558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:53.170538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cdaf974c-2a0d-48fc-a175-945b6f83da2c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1751 microversion: 2.1 time: 0.164405 Aug 10 10:06:53.171128 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 251/502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:53 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:53.198258 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:53.198991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:53.205220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.205733 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.206179 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.206900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.207413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.207883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.229831 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:53.230443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:53.236499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.236982 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.237422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.238108 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.238563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.239009 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.405976 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:53.412953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:53.414550 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ac41f9a5-ee33-4ba1-91d9-fe9cdec95cee tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1680 microversion: 2.1 time: 0.221043 Aug 10 10:06:53.415220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 252/503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:53 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:53.417185 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:53.420404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:53.421084 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:53.425185 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:53.427413 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:53.427569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.428299 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.428569 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3a6439ee-ea8d-4db0-8eb8-2ab5d2e56d03 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1745 microversion: 2.20 time: 0.202942 Aug 10 10:06:53.428868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.430979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 252/504] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:53 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:53.431136 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:53.431136 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:53.431453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:53.563261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:53.570644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-24d93b8a-5706-441b-8050-1dd6c2f948fa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1265 microversion: 2.1 time: 0.154316 Aug 10 10:06:53.571189 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 253/505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:53 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:54.191760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:54.192531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:54.200908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.201403 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.201844 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.202588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.203071 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.203503 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.357076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:54.366735 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b74dd2d8-afad-4537-bcc8-f6b1aa36be62 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1751 microversion: 2.1 time: 0.178779 Aug 10 10:06:54.367403 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 253/506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:54 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:54.436298 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:54.436872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:54.443240 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.443729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.444171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.444868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.445330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.445762 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.453162 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:54.454038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:54.460458 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.461620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.462169 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.463105 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.463790 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.464460 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.635851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:54.643226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-555e2c94-a61e-4c57-b6a3-5670bfcafb98 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1680 microversion: 2.1 time: 0.210836 Aug 10 10:06:54.643798 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 254/507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:54 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:54.648710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:54.649537 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:54.655781 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.656288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.656732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.657446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.657911 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.658337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.664238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:54.672314 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:54.673911 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:54.675188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5fc21dd7-0c3d-47fc-b364-a79c2b7bf874 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1745 microversion: 2.20 time: 0.226831 Aug 10 10:06:54.676032 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 254/508] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:54 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:54.788523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:54.796146 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2962fcb5-e1f0-4b70-abda-366e14d43dfa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1452 microversion: 2.1 time: 0.151390 Aug 10 10:06:54.796717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 255/509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:54 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:54.816405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:54.817018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:54.823357 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.823840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.824276 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:54.824960 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:54.825415 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:54.825841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:55.192969 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:55.202363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3eb6d57a-546c-49f1-9064-0436314bce79 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1452 microversion: 2.1 time: 0.389691 Aug 10 10:06:55.203085 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 255/510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:54 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1452 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:55.388898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:55.389437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:55.395500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:55.396254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:55.396881 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:55.397749 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:55.398396 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:55.399043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:55.644511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:55.652697 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1bc40b34-76ab-44d1-b2c0-5e874793fec4 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1751 microversion: 2.1 time: 0.267927 Aug 10 10:06:55.653368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 256/511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:55 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1751 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:55.667882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:55.669586 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:55.678402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:55.680075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:55.681224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:55.682370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:55.683722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:55.684249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:55.700497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:55.701670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:55.722003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:55.722555 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:55.723149 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:55.723934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:55.724379 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:55.724808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:55.734558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:55.794383 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:55.803909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8760a1bf-6e45-4d0c-a3a3-bab6411c8cf8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 200 len: 1612 microversion: 2.1 time: 0.141234 Aug 10 10:06:55.805255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 256/512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:55 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 1612 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:55.952167 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:55.961986 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:55.964538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:55.965796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-65df3388-eaf2-4845-9282-4d2591bdd09d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1745 microversion: 2.20 time: 0.270145 Aug 10 10:06:55.966903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 257/513] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:55 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1745 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:06:56.040974 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-c8393713-3c27-45a8-9521-b0fa6c88fd68 req-ee88bba1-545d-4c93-bc53-8f79703ee5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14284420-f1ed-4de0-a217-90e8b43f96a0", "name": "network-vif-deleted", "tag": "074aae6e-f943-4601-9a0d-aa24ebcb88f4"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:56.068366 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c8393713-3c27-45a8-9521-b0fa6c88fd68 req-ee88bba1-545d-4c93-bc53-8f79703ee5a5 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:56.069052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c8393713-3c27-45a8-9521-b0fa6c88fd68 req-ee88bba1-545d-4c93-bc53-8f79703ee5a5 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:56.069554 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c8393713-3c27-45a8-9521-b0fa6c88fd68 req-ee88bba1-545d-4c93-bc53-8f79703ee5a5 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:56.086183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-c8393713-3c27-45a8-9521-b0fa6c88fd68 req-ee88bba1-545d-4c93-bc53-8f79703ee5a5 service nova] Creating event network-vif-deleted:074aae6e-f943-4601-9a0d-aa24ebcb88f4 for instance 14284420-f1ed-4de0-a217-90e8b43f96a0 on hv-cinder-85083 Aug 10 10:06:56.091967 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-c8393713-3c27-45a8-9521-b0fa6c88fd68 req-ee88bba1-545d-4c93-bc53-8f79703ee5a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055798 Aug 10 10:06:56.092890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 257/514] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:56.430522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-646eb9a3-c696-4da1-82ae-c6f5993007f7 req-dfb75310-9a44-424f-8460-43b5b376b8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9", "name": "network-vif-plugged", "status": "completed", "tag": "572a9818-c1ee-4385-bd79-7c0a76329a99"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:56.443113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-646eb9a3-c696-4da1-82ae-c6f5993007f7 req-dfb75310-9a44-424f-8460-43b5b376b8aa service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:56.443688 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-646eb9a3-c696-4da1-82ae-c6f5993007f7 req-dfb75310-9a44-424f-8460-43b5b376b8aa service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:56.445965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-646eb9a3-c696-4da1-82ae-c6f5993007f7 req-dfb75310-9a44-424f-8460-43b5b376b8aa service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:56.457551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-646eb9a3-c696-4da1-82ae-c6f5993007f7 req-dfb75310-9a44-424f-8460-43b5b376b8aa service nova] Creating event network-vif-plugged:572a9818-c1ee-4385-bd79-7c0a76329a99 for instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 on hv-cinder-85083 Aug 10 10:06:56.463209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-646eb9a3-c696-4da1-82ae-c6f5993007f7 req-dfb75310-9a44-424f-8460-43b5b376b8aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038278 Aug 10 10:06:56.464348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 258/515] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:56.678088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:56.678818 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:56.686326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:56.687080 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:56.687770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:56.688646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:56.689268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:56.689857 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:56.827088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:56.828586 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:56.838560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:56.840360 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:56.841004 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:56.842575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:56.843244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:56.844547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:56.862311 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 HTTP/1.1 Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:06:56.864024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:06:56.865593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '14284420-f1ed-4de0-a217-90e8b43f96a0'} Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:06:56.866475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:06:56.868547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:06:56.869849 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:06:56.869849 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d208cd33-7845-40b8-a969-40691f7a67e1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 404 len: 111 microversion: 2.1 time: 0.044170 Aug 10 10:06:56.870073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 259/516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:56 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 10:06:56.874623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f3e7672c-b90c-4022-bf1b-6557d70d60a1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '.version_select at 0x7f22fbf288b0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:56.899684 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f3e7672c-b90c-4022-bf1b-6557d70d60a1 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467445688" status: 202 len: 0 microversion: 2.1 time: 0.028430 Aug 10 10:06:56.900166 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 260/517] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 10 10:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467445688 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:06:56.952803 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:56.965014 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-083963d0-da36-48ad-a706-93c9b04bce48 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.291099 Aug 10 10:06:56.966493 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 258/518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:56 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:56.999984 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:57.001944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:57.011052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:57.012882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:57.013714 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:57.014746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:57.017380 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:57.018729 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:57.301917 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:57.313434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:57.315041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:57.325917 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8aafc697-a558-43f7-85c4-a9c8f81afb66 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1745 microversion: 2.20 time: 0.336936 Aug 10 10:06:57.326520 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 261/519] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:56 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1745 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:57.544151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-491b3bce-46c7-4dba-84d7-3d3746eec910 req-895bbbf8-33a2-4ae4-be82-0177ded402ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479fd26a-e2a8-4d55-a760-afbc7de61715", "tag": "94e22129-7a42-4420-8f52-51b45bb6fffc"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:06:57.553536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:57.566469 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-491b3bce-46c7-4dba-84d7-3d3746eec910 req-895bbbf8-33a2-4ae4-be82-0177ded402ea service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:57.567312 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-491b3bce-46c7-4dba-84d7-3d3746eec910 req-895bbbf8-33a2-4ae4-be82-0177ded402ea service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:57.569358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-491b3bce-46c7-4dba-84d7-3d3746eec910 req-895bbbf8-33a2-4ae4-be82-0177ded402ea service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:57.609440 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-491b3bce-46c7-4dba-84d7-3d3746eec910 req-895bbbf8-33a2-4ae4-be82-0177ded402ea service nova] Creating event network-changed:94e22129-7a42-4420-8f52-51b45bb6fffc for instance 479fd26a-e2a8-4d55-a760-afbc7de61715 on hv-cinder-85083 Aug 10 10:06:57.619957 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-491b3bce-46c7-4dba-84d7-3d3746eec910 req-895bbbf8-33a2-4ae4-be82-0177ded402ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079695 Aug 10 10:06:57.627545 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 259/520] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:57.991403 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:57.993112 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:57.994433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:57.995052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:58.003445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.004858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.005054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.005561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.005791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.006010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.007949 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.008586 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.009179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.010706 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.014513 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.015237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.147775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lazy-loading 'services' on Instance uuid 50513b4b-53a2-4825-821b-07ff035fe17c {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:06:58.275814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8d1699f1-498c-4657-9c48-5f4b6870694a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments/28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9" status: 202 len: 0 microversion: 2.1 time: 0.286608 Aug 10 10:06:58.280446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 260/521] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:06:57 2022] DELETE /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments/28c37ed8-2cfd-4eb9-b4d8-212ebd4aa3d9 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 10:06:58.293703 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:58.300648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:58.314702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.328563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.329960 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.333058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.333833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.336434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.355336 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:58.369043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-98371c76-e853-4899-b9d7-36cbb9b861dd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.383237 Aug 10 10:06:58.377950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 262/522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:57 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:58.393665 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:58.401434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:58.411662 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:58.430924 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-11f261be-b868-4591-b0b2-045d0a020f7f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148888 Aug 10 10:06:58.438800 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.439768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.444902 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 261/523] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:06:58 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:06:58.445933 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.447772 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:58.449428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:58.450338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:58.717853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:58.729853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:58.734250 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:58.736358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a91e6b0e-9150-4e53-963a-a373165e5481 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.355486 Aug 10 10:06:58.737678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 263/524] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:58 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:06:59.397581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:59.398846 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:59.405848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.406480 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.410812 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.412166 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.414151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.416009 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.453946 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:59.457423 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:59.500278 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.501358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.502256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.508891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.509710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.511499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.608706 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cc31aefd-b1ec-415e-b76b-cf4ff74c2eed tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.160366 Aug 10 10:06:59.613609 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 264/525] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:06:59 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:06:59.620499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:06:59.630817 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b094d865-cdc7-472d-8cca-20280eae31eb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.237134 Aug 10 10:06:59.632891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 262/526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:59 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:06:59.704314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:59.707750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:59.721538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.722330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.722941 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.726389 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.727111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.728404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.765275 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:59.766037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:59.775540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:06:59.776943 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.777696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.778304 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.779201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.779966 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.780604 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.933061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cba2563e-ffd5-4b53-9ced-6bbaa3f3f95f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 204 len: 0 microversion: 2.1 time: 0.234612 Aug 10 10:06:59.933990 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 265/527] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:06:59 2022] DELETE /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:06:59.948425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:06:59.949154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:06:59.963320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.963827 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.964276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:06:59.964994 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:06:59.965463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:06:59.965930 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:00.131447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:00.143944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:00.147151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:00.150775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5f4d46bf-e3e8-49e4-b9a1-8b148cb9793e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.389843 Aug 10 10:07:00.167119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 263/528] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:06:59 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:00.227757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:00.242761 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1900d92d-6aed-468b-8236-21bbffdf01c2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1682 microversion: 2.1 time: 0.304358 Aug 10 10:07:00.243876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 266/529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:06:59 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:00.663704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:00.664380 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:00.671165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:00.671655 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:00.672130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:00.672775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:00.673227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:00.673651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:00.843673 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:00.852534 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b1635e83-e510-4a6f-81c8-dd38024e92fd tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.197621 Aug 10 10:07:00.866408 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 264/530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:00 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:01.180610 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:01.182525 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:01.189740 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:01.190501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:01.191216 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:01.192161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:01.192720 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:01.193359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:01.266786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:01.267823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:01.275283 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:01.276103 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:01.277784 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:01.278737 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:01.280110 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:01.280922 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:01.396305 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:01.417841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:01.421429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:01.424880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f9169cd3-3e6e-46a9-8cbd-45f775aa11c6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.248340 Aug 10 10:07:01.432987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 267/531] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:01 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:01.499593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:01.508552 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f40ca086-5811-45f0-acb6-f6d2d6b19bb7 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1682 microversion: 2.1 time: 0.246797 Aug 10 10:07:01.509125 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 265/532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:01 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:07:01.875156 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:01.876383 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:01.885624 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:01.886123 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:01.886574 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:01.887338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:01.887965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:01.888554 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:02.079421 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:02.089075 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-23a971ab-cba1-4f1f-8502-fe8e95198658 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.218474 Aug 10 10:07:02.089744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 268/533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:01 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:02.461187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:02.461795 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:02.469049 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:02.469794 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:02.470396 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:02.471303 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:02.471922 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:02.472505 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:02.533973 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:02.534932 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:02.555047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:02.555563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:02.557707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:02.558628 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:02.559304 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:02.560956 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:02.787005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:02.795274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:02.803612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:02.805178 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bc064b8c-bc03-481f-8e98-47a165ab9e68 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.348925 Aug 10 10:07:02.805907 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 266/534] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:02 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:02.890467 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:02.899893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-57fb0ccb-4169-4571-940d-51c602f9a6ea tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 200 len: 1682 microversion: 2.1 time: 0.373627 Aug 10 10:07:02.900926 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 269/535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:02 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 1682 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:03.063411 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-e7599e31-18c9-4760-93e8-6b74444b0da1 req-159f7919-7ab3-4470-9f86-b96f6ee8a9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50513b4b-53a2-4825-821b-07ff035fe17c", "name": "network-vif-deleted", "tag": "96d57bd3-ced6-4c5a-bddb-15f267527a3d"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:03.077975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-e7599e31-18c9-4760-93e8-6b74444b0da1 req-159f7919-7ab3-4470-9f86-b96f6ee8a9ed service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:03.078777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-e7599e31-18c9-4760-93e8-6b74444b0da1 req-159f7919-7ab3-4470-9f86-b96f6ee8a9ed service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:03.079486 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-e7599e31-18c9-4760-93e8-6b74444b0da1 req-159f7919-7ab3-4470-9f86-b96f6ee8a9ed service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:03.112324 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-e7599e31-18c9-4760-93e8-6b74444b0da1 req-159f7919-7ab3-4470-9f86-b96f6ee8a9ed service nova] Creating event network-vif-deleted:96d57bd3-ced6-4c5a-bddb-15f267527a3d for instance 50513b4b-53a2-4825-821b-07ff035fe17c on hv-cinder-85083 Aug 10 10:07:03.117370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:03.119280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:03.121132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-e7599e31-18c9-4760-93e8-6b74444b0da1 req-159f7919-7ab3-4470-9f86-b96f6ee8a9ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062572 Aug 10 10:07:03.124067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 267/536] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:03.137620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:03.138027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:03.154294 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:03.167021 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:03.168020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:03.168661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:03.641408 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:03.654595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4971712d-8d8f-4996-aace-6d633deb197f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.548267 Aug 10 10:07:03.670714 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 270/537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:03 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:03.831369 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:03.832264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:03.845377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:03.854725 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:03.855430 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:03.856483 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:03.857214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:03.857705 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:03.922005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:03.922527 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:03.932563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:03.939184 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:03.940081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:03.941169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:03.941801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:03.942376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:03.962674 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c HTTP/1.1 Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:07:03.964563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:07:03.966192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '50513b4b-53a2-4825-821b-07ff035fe17c'} Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:07:03.967103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:07:03.968543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:03.974539 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:07:03.975763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fe7faf31-73f2-4aae-ab56-06e712950fa8 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 404 len: 111 microversion: 2.1 time: 0.057936 Aug 10 10:07:03.976905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 271/538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:03 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:07:03.988532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-baf899a7-5c46-4a29-8c84-5fd80c0264f9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '.version_select at 0x7f22fbf283a0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:04.028757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-baf899a7-5c46-4a29-8c84-5fd80c0264f9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-309494928" status: 202 len: 0 microversion: 2.1 time: 0.047051 Aug 10 10:07:04.029624 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 272/539] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 10 10:07:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-309494928 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:07:04.098441 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:04.108443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:04.110236 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:04.112726 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a7b306d9-b161-4263-8467-bed31c8c6d2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.286291 Aug 10 10:07:04.127001 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 268/540] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:03 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:04.680639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:04.680639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:04.695373 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:04.696181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:04.697895 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:04.703010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:04.703442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:04.703894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:04.985709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:04.997657 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b6ab4e1d-9a44-4c0e-ae22-c66653bd272a tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.324347 Aug 10 10:07:05.019131 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 273/541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:04 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:05.128210 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-21684411-1def-481b-ae2b-e6d243dd67c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: .version_select at 0x7f22fbfb9ca0>, body: {"keypair": {"name": "tempest-keypair-1418367340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRT2mA4a4G4pg6ekQ5/2ZaeO0Xwpb+l0mout3ctYFR+/4eDjFtUU+nauPpKSX6UtX9JTfW+ufC16vTQ5Injf26hgGWovYrsSzVo++TI8ru43fdD4A2qukqpizu26Y5y2w=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:05.137786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:05.138923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:05.149462 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-21684411-1def-481b-ae2b-e6d243dd67c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:07:05.152067 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:05.153126 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:05.154091 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:05.154514 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-21684411-1def-481b-ae2b-e6d243dd67c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:07:05.155715 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:05.157151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:05.158124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:05.179037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-21684411-1def-481b-ae2b-e6d243dd67c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055099 Aug 10 10:07:05.185455 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 269/542] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:07:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:05.378347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:05.389758 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:05.391349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:05.392687 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-893adb7e-0f24-498c-b2b0-5a1bc55f2876 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.259641 Aug 10 10:07:05.393248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 274/543] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:05 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:06.030544 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:06.031772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:06.042431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:06.047087 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:06.053832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:06.055209 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:06.055925 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:06.056607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:06.348587 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:06.359672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3e6a266e-8a07-4224-a16b-bae34af0bdef tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.335092 Aug 10 10:07:06.374120 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 270/544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:06 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:06.425223 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:06.425833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:06.432375 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:06.433096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:06.433727 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:06.434753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:06.435428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:06.439887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:06.669395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:06.684071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:06.685906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:06.687190 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f9fce9de-a0e1-41c2-86d6-56f88e00b940 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.268247 Aug 10 10:07:06.707007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 275/545] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:06 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:07.092561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-35058585", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0883fa82-bc1b-403f-a6c6-d9e718def253"}], "security_groups": [{"name": "tempest-securitygroup--468515114"}], "key_name": "tempest-keypair-1418367340", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:07.215321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] validate_networks() for [('0883fa82-bc1b-403f-a6c6-d9e718def253', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:07:07.381667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:07.383041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:07.399915 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:07.403070 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:07.403737 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:07.404682 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:07.414382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:07.415276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:07.420388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:07.707222 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:07.718716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-337318b1-9613-4468-8c57-e2e71bd36193 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.340744 Aug 10 10:07:07.738699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 276/546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:07 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:07.743792 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:07.744609 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:07.751561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:07.752289 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:07.753001 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:07.753982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:07.754600 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:07.759182 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:07.787954 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:07:07.792068 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:07:07.797420 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:07:07.798348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:07:07.799199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:07:07.809939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:07.810870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:07.811553 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:07.812521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:07.813141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:07.813731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:07.836511 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:07:07.841642 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:07:07.859170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:07:07.861852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:07:07.918822 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3472acea-4f68-4646-b850-55bbf29be653 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.830563 Aug 10 10:07:07.920196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 271/547] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:07:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:07:07.933405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fd853edc-3da0-4af0-9019-e2a950dcce26 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:07.934290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-fd853edc-3da0-4af0-9019-e2a950dcce26 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:07.945022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:07.955006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:07.956394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:07.957959 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6018d44c-40e5-43e7-a69f-7955009eb99c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.218134 Aug 10 10:07:07.958732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 277/548] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:07 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:08.013274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-fd853edc-3da0-4af0-9019-e2a950dcce26 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:08.020504 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fd853edc-3da0-4af0-9019-e2a950dcce26 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1240 microversion: 2.1 time: 0.091619 Aug 10 10:07:08.035077 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 272/549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:07 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:08.740670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:08.741302 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:08.750035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:08.750538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:08.752040 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:08.752767 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:08.753234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:08.753843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:08.924041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:08.932870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3b4cc30f-828d-46e5-b0a2-66c2dac8f300 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.196014 Aug 10 10:07:08.946738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 278/550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:08 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:08.982668 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:08.985629 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:08.990519 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:08.991059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:08.992002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:08.992736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:08.993423 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:08.994211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:09.017278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:09.045471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:09.046352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:09.053169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:09.054428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:09.055172 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:09.056286 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:09.056754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:09.057190 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:09.178732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:09.182831 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:09.188147 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a522276e-6ac4-44d4-a0d8-000282fe1978 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1292 microversion: 2.1 time: 0.147209 Aug 10 10:07:09.189315 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 279/551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:09 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1292 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:07:09.206920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:09.209078 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:09.211443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-766aaa0d-2813-460c-ae08-d1c1b643059a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1740 microversion: 2.20 time: 0.232605 Aug 10 10:07:09.212008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 273/552] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:08 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:09.954293 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:09.954993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:09.967771 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:09.968691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:09.969853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:09.970999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:09.971705 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:09.972326 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:10.128077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:10.136777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dd56e5c6-4b7b-41fc-9722-fb429c5b7739 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.186883 Aug 10 10:07:10.137414 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 280/553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:09 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:10.211267 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:10.211891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:10.218529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:10.219075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:10.219522 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:10.220217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:10.220668 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:10.221111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:10.235203 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:10.236410 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:10.242629 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:10.243153 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:10.243592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:10.244286 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:10.244738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:10.245343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:10.420782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:10.426008 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:10.433354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-806f6627-e4b1-43ee-b839-2b38e9853c4b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1365 microversion: 2.1 time: 0.226797 Aug 10 10:07:10.434343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 274/554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:10 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:10.436750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:10.438666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:10.440023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ea7189a6-9779-4bbe-ac3c-a89378df644c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1722 microversion: 2.20 time: 0.208767 Aug 10 10:07:10.440763 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 281/555] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:10 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:10.904337 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-32773c81-44be-460c-bf58-7ca006d60177 req-afa7e6f3-4fb9-493c-b9b6-5abe02697164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a806be-ce2e-41ba-bcac-a3934f0addc8", "tag": "3c234633-ee96-48cb-91d9-44a20cdd20a2"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:10.914614 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-32773c81-44be-460c-bf58-7ca006d60177 req-afa7e6f3-4fb9-493c-b9b6-5abe02697164 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:10.915445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-32773c81-44be-460c-bf58-7ca006d60177 req-afa7e6f3-4fb9-493c-b9b6-5abe02697164 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:10.916041 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-32773c81-44be-460c-bf58-7ca006d60177 req-afa7e6f3-4fb9-493c-b9b6-5abe02697164 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:10.927351 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-32773c81-44be-460c-bf58-7ca006d60177 req-afa7e6f3-4fb9-493c-b9b6-5abe02697164 service nova] Creating event network-changed:3c234633-ee96-48cb-91d9-44a20cdd20a2 for instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 on hv-cinder-85083 Aug 10 10:07:10.933541 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-32773c81-44be-460c-bf58-7ca006d60177 req-afa7e6f3-4fb9-493c-b9b6-5abe02697164 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032600 Aug 10 10:07:10.934145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 275/556] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:11.157589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:11.158128 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:11.165148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:11.165625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:11.166061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:11.166746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:11.167222 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:11.167647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:11.311003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:11.319028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0aa78595-a003-488d-aa25-9e47125265e9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.165263 Aug 10 10:07:11.320193 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 282/557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:11 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:11.456363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:11.457415 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:11.463965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:11.464443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:11.464908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:11.465586 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:11.466079 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:11.466507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:11.471220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:11.471831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:11.477879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:11.478366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:11.478804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:11.479556 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:11.479995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:11.480418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:11.659874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:11.668669 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bfe23cc6-da09-43af-9b41-b2d2f3f462de tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1365 microversion: 2.1 time: 0.216425 Aug 10 10:07:11.668847 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:11.669816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 276/558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:11 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:11.676816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:11.678330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:11.680169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-669d1bdb-7f8a-4b42-a310-d7aada39c12f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1722 microversion: 2.20 time: 0.212748 Aug 10 10:07:11.680719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 283/559] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:11 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:12.235962 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d46b1a22-0df6-4e4a-a42f-89ecdd5b9718 req-a3e1fad4-e9f8-4107-b51d-0cb50e7578b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9", "name": "network-vif-unplugged", "status": "completed", "tag": "572a9818-c1ee-4385-bd79-7c0a76329a99"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:12.245228 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d46b1a22-0df6-4e4a-a42f-89ecdd5b9718 req-a3e1fad4-e9f8-4107-b51d-0cb50e7578b2 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:12.245663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d46b1a22-0df6-4e4a-a42f-89ecdd5b9718 req-a3e1fad4-e9f8-4107-b51d-0cb50e7578b2 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:12.246198 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d46b1a22-0df6-4e4a-a42f-89ecdd5b9718 req-a3e1fad4-e9f8-4107-b51d-0cb50e7578b2 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:12.258606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d46b1a22-0df6-4e4a-a42f-89ecdd5b9718 req-a3e1fad4-e9f8-4107-b51d-0cb50e7578b2 service nova] Creating event network-vif-unplugged:572a9818-c1ee-4385-bd79-7c0a76329a99 for instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 on hv-cinder-85083 Aug 10 10:07:12.263518 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-d46b1a22-0df6-4e4a-a42f-89ecdd5b9718 req-a3e1fad4-e9f8-4107-b51d-0cb50e7578b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031248 Aug 10 10:07:12.264111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 277/560] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:12.340711 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:12.341335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:12.347951 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:12.348436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:12.348878 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:12.349570 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:12.350060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:12.350494 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:12.487939 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:12.496854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0516eade-8734-4de4-b5ae-4eedb2c00095 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.159960 Aug 10 10:07:12.497427 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 284/561] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:12 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:12.690722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:12.691381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:12.698130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:12.698612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:12.699089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:12.699775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:12.700235 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:12.700661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:12.702434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:12.703327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:12.709073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:12.709556 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:12.709991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:12.710679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:12.711165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:12.711614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:12.913856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:12.919844 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:12.932216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b986aba7-0121-41e1-9be5-cca62a79f46f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1365 microversion: 2.1 time: 0.246149 Aug 10 10:07:12.935603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:12.937215 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:12.937943 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 278/562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:12 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:12.943289 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b265b081-ba62-46ee-bcfb-8a32898475e3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1722 microversion: 2.20 time: 0.244493 Aug 10 10:07:12.943916 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 285/563] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:12 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:13.004854 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f57ee3c-f149-4b67-a07a-6e2eff4e8ad9"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:13.007252 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:13.013132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.013613 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.014052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:13.014763 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.015243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.015670 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:13.393648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-da675b3f-4f98-40d1-b393-2f669e70040f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392900 Aug 10 10:07:13.394726 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 279/564] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:07:12 2022] POST /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:13.518026 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:13.518641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:13.525066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.525553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:13.526688 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.527181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.527615 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:13.667471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:13.675404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e6f9bbbb-9760-42de-94d5-24b7313f341c tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.161217 Aug 10 10:07:13.675969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 286/565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:13 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:13.958830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:13.959497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:13.966076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:13.966363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.966682 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:13.966858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.967334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:13.968034 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.968495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.968929 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:13.972689 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.973184 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.973627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:13.974317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:13.974784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:13.975224 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.157786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:14.164064 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:14.172054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:14.172327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-71a99399-bf29-458c-b13b-e81cb05ee1fd tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1365 microversion: 2.1 time: 0.218320 Aug 10 10:07:14.173097 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 280/566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:13 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:14.173621 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:14.174776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-808d67c8-8d94-4ad2-bb5a-d952c29ffabf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1665 microversion: 2.20 time: 0.212623 Aug 10 10:07:14.175352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 287/567] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:13 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1665 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:14.198190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e6047cb-050a-4fa6-a14d-5e36b6ac5f65"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:14.200729 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:14.206610 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.207132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.207579 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.208278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.208740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.209233 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.521568 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6c5337a3-1aa5-4b96-849c-df5935de7105 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327811 Aug 10 10:07:14.522262 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 281/568] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Aug 10 10:07:14 2022] POST /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:07:14.666383 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:14.666996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:14.673597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.674095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.674541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.675292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.675753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.676180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.697436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:14.698622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:14.706155 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.708681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.708681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.708681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.709497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.710134 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.733375 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117895) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 10:07:14.830640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dec8c407-e260-4a9c-8ca2-7d3a67c79744 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/action" status: 202 len: 0 microversion: 2.20 time: 0.168478 Aug 10 10:07:14.835247 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 288/569] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 10 10:07:14 2022] POST /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:07:14.840298 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:14.841155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:14.847282 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.848068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.848657 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.849375 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:14.849833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:14.850260 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:14.965691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:14.978815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9f480a9a-d7f6-4ba4-b49c-d9beba518551 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.285834 Aug 10 10:07:14.993314 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 282/570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:14 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:07:15.023000 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:15.036817 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:15.038934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:15.040140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-97f26174-e647-4392-9702-d7a641022fa3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1751 microversion: 2.20 time: 0.203775 Aug 10 10:07:15.040692 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 289/571] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:14 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:15.193651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:15.194271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:15.200928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:15.201454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:15.202179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:15.202923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:15.203572 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:15.204053 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:15.369974 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:15.379215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-512ff0a1-7143-4ba4-bb05-0fee2f5ed76d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1365 microversion: 2.1 time: 0.189320 Aug 10 10:07:15.380399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 283/572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:15 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:16.000431 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:16.001376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:16.008760 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:16.009237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:16.009699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:16.010382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:16.010843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:16.011301 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:16.062917 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:16.063586 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:16.069791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:16.070278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:16.070911 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:16.071659 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:16.072118 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:16.072716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:16.196701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:16.205298 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ecd62d3a-bdbb-408c-901b-26d06f428612 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.208676 Aug 10 10:07:16.205884 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 290/573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:15 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:16.240574 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:16.249830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:16.251818 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:16.253028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-72ad1c54-d6db-49ab-85dd-0cde385e242a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1753 microversion: 2.20 time: 0.194041 Aug 10 10:07:16.253682 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 284/574] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:16 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:16.401450 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:16.402453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:16.408486 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:16.408992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:16.409439 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:16.410148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:16.410612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:16.411071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:16.423187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-c93b0933-23e7-4fe7-829b-d84d584d3d64 req-dc3009e9-3721-4cb0-88fc-0040b6b2d0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a806be-ce2e-41ba-bcac-a3934f0addc8", "name": "network-vif-plugged", "status": "completed", "tag": "3c234633-ee96-48cb-91d9-44a20cdd20a2"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:16.433895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c93b0933-23e7-4fe7-829b-d84d584d3d64 req-dc3009e9-3721-4cb0-88fc-0040b6b2d0e2 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:16.434397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c93b0933-23e7-4fe7-829b-d84d584d3d64 req-dc3009e9-3721-4cb0-88fc-0040b6b2d0e2 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:16.434836 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c93b0933-23e7-4fe7-829b-d84d584d3d64 req-dc3009e9-3721-4cb0-88fc-0040b6b2d0e2 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:16.446412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-c93b0933-23e7-4fe7-829b-d84d584d3d64 req-dc3009e9-3721-4cb0-88fc-0040b6b2d0e2 service nova] Creating event network-vif-plugged:3c234633-ee96-48cb-91d9-44a20cdd20a2 for instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 on hv-cinder-85083 Aug 10 10:07:16.451742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-c93b0933-23e7-4fe7-829b-d84d584d3d64 req-dc3009e9-3721-4cb0-88fc-0040b6b2d0e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Aug 10 10:07:16.452643 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 285/575] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:07:16.577120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:16.580909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:16.586186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d36a7ef1-dd21-4575-b765-774acf8b4ab9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1365 microversion: 2.1 time: 0.189382 Aug 10 10:07:16.586751 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 291/576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:16 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:17.226548 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:17.227266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:17.233349 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:17.233832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:17.234267 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:17.234969 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:17.235433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:17.235865 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:17.278002 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:17.278759 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:17.285890 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:17.286448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:17.287003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:17.287796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:17.288315 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:17.288805 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:17.430268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:17.438336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b57a2c89-d013-4667-a526-fdf83ad0e433 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.216434 Aug 10 10:07:17.438909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 286/577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:17 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:17.459523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:17.468021 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:17.469747 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:17.470983 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ee9ae1e4-460e-430a-8e7c-7bc0da0b3cc7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1753 microversion: 2.20 time: 0.197597 Aug 10 10:07:17.471553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 292/578] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:17 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:17.607114 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:17.607735 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:17.613730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:17.614220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:17.614664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:17.615384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:17.615851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:17.616326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:17.742274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:17.749620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c9a388ce-ed8a-4d29-b839-067d3edff482 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1365 microversion: 2.1 time: 0.146378 Aug 10 10:07:17.750187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 287/579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:17 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:18.460566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:18.461185 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:18.467545 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.468048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.468489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:18.469265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.469743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.470183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:18.494144 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:18.494760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:18.496740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:18.497438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=12 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:18.504621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.505111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.505551 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:18.506249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.506704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.507176 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:18.511381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:18.678437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:18.686298 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fb61cd28-9aad-4bc0-b726-5ae6589f7e6f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1756 microversion: 2.1 time: 0.229645 Aug 10 10:07:18.698981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 293/580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:18 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:18.699625 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:18.699625 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:18.699915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:18.701216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b9910d60-02b7-47a8-b510-58d47711cdc2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1753 microversion: 2.20 time: 0.211534 Aug 10 10:07:18.701781 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 288/581] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:18 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:18.770857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:18.771500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:18.777906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.778396 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.778838 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:18.779565 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.780028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.780458 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:18.908628 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:18.916673 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b78b0a6c-45ee-4a3f-bf37-aae23fdc8580 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1555 microversion: 2.1 time: 0.149659 Aug 10 10:07:18.917243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 294/582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:18 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:18.936915 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:18.937348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:18.943261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.943739 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.944179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:18.944980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:18.945441 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:18.945864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:19.020165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-84872758-aa8e-4360-98cf-5bb9a04bf879 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087053 Aug 10 10:07:19.020765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 289/583] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:07:18 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:19.708430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:19.708971 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:19.715563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:19.716056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:19.716503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:19.717218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:19.717675 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:19.718141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:19.725171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:19.725955 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:19.732302 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:19.732791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:19.733228 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:19.733932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:19.734581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:19.735042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:20.158558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:20.167470 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:20.168976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:20.170138 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-05cb3a2f-e085-4931-8a34-af6c89a4da41 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1753 microversion: 2.20 time: 0.449381 Aug 10 10:07:20.171744 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 290/584] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:19 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1753 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:20.179113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:20.188259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4f06f459-9466-40c0-ba7e-54e20f623128 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1759 microversion: 2.1 time: 0.483846 Aug 10 10:07:20.188995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 295/585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:19 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1759 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:20.320005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-54a28d9a-6fb8-4458-bb0f-79e2f5c9724a req-ffb189f2-51b8-49fd-abb9-8b7d46d5ebe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a806be-ce2e-41ba-bcac-a3934f0addc8", "tag": "3c234633-ee96-48cb-91d9-44a20cdd20a2"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:20.329370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-54a28d9a-6fb8-4458-bb0f-79e2f5c9724a req-ffb189f2-51b8-49fd-abb9-8b7d46d5ebe3 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:20.329928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-54a28d9a-6fb8-4458-bb0f-79e2f5c9724a req-ffb189f2-51b8-49fd-abb9-8b7d46d5ebe3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:20.330360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-54a28d9a-6fb8-4458-bb0f-79e2f5c9724a req-ffb189f2-51b8-49fd-abb9-8b7d46d5ebe3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:20.341673 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-54a28d9a-6fb8-4458-bb0f-79e2f5c9724a req-ffb189f2-51b8-49fd-abb9-8b7d46d5ebe3 service nova] Creating event network-changed:3c234633-ee96-48cb-91d9-44a20cdd20a2 for instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 on hv-cinder-85083 Aug 10 10:07:20.347742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-54a28d9a-6fb8-4458-bb0f-79e2f5c9724a req-ffb189f2-51b8-49fd-abb9-8b7d46d5ebe3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034064 Aug 10 10:07:20.349035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 291/586] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:21.193906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:21.194567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:21.201612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:21.202132 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:21.202585 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:21.203453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:21.203971 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:21.204352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:21.370200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:21.379270 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:21.380619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:21.382292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b241b3c8-8e45-4b48-a23c-7823e3ba830c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1753 microversion: 2.20 time: 0.191876 Aug 10 10:07:21.382855 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 296/587] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:21 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1753 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:22.008327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:22.010873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:22.017553 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:22.018374 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:22.018508 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:22.019203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:22.019664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:22.020091 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:22.042662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lazy-loading 'flavor' on Instance uuid 3c63d7ad-f726-40c4-81d9-b7be9492211b {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:07:22.165134 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d82f8fc2-3648-4dd6-8edf-6f633650858c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/action" status: 200 len: 32 microversion: 2.1 time: 0.161755 Aug 10 10:07:22.165771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 292/588] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:07:22 2022] POST /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:07:22.175398 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:22.176111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:22.183393 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:22.184134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:22.184702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:22.185413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:22.185877 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:22.186309 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:22.319813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:22.328076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-21636214-2cda-4e7b-bcc2-31f7bcde05db tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.156800 Aug 10 10:07:22.328645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 297/589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:22 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:22.413119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:22.413833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:22.419916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:22.420403 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:22.420837 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:22.421562 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:22.422016 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:22.422442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:22.556642 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:22.568724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:22.572931 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:22.574218 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-bcd40c7c-872c-4de6-b361-bead131709ba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.170518 Aug 10 10:07:22.588655 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 293/590] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:22 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:23.350148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:23.352073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:23.359320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:23.359816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:23.360260 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:23.360970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:23.361430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:23.361859 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:23.498638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:23.507156 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d11f0b10-8a32-4224-9fe6-6fcc9e146502 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.161156 Aug 10 10:07:23.523521 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 298/591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:23 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:23.597811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:23.598598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:23.605381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:23.605870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:23.606318 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:23.607093 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:23.607558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:23.608019 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:23.744081 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:23.753346 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:23.754839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:23.756025 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-76f5810c-afc6-4ea3-9983-02f410018561 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.162307 Aug 10 10:07:23.757115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 294/592] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:23 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:24.530501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:24.531359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:24.538472 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:24.539398 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:24.540082 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:24.541031 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:24.541703 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:24.542346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:24.689171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:24.697863 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-603a54a7-4b32-438e-b2b1-ab435464a61e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.171139 Aug 10 10:07:24.703504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 299/593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:24 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:24.787141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:24.788489 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:24.792137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:24.796749 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:24.797237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:24.797687 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:24.798376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:24.798829 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:24.799280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:24.944184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:24.952729 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:24.954339 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:24.955573 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dfef31f2-aba3-48ac-924c-a6bcf752ced2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.173020 Aug 10 10:07:24.956335 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 295/594] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:24 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:25.719910 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:25.720684 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:25.727528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:25.728013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:25.728456 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:25.729140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:25.729595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:25.730049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:25.870930 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:25.882604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6fd92d63-da0d-48c7-bd75-16ce74b020f0 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.165881 Aug 10 10:07:25.883486 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 300/595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:25 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:07:25.980054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:25.980722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:25.988405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:25.988908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:25.989360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:25.990112 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:25.990522 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:25.991048 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:26.131352 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:26.140098 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:26.141612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:26.142784 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-aec97b21-a6a2-48b8-8ce1-eeaef56581de tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.166957 Aug 10 10:07:26.143479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 296/596] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:25 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:26.904484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:26.905135 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:26.911423 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:26.911907 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:26.912351 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:26.913087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:26.913573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:26.914048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:27.066730 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:27.077614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-13f9ea31-f964-4cef-adf1-6e4425f0a70d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.177066 Aug 10 10:07:27.078217 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 301/597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:26 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:27.167384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:27.168823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:27.175581 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:27.176500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:27.177244 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:27.178190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:27.179132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:27.179787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:27.318141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:27.327215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:27.328854 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:27.329907 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e159544e-95a5-4e56-afd8-7b05afcc8384 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.167448 Aug 10 10:07:27.330465 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 297/598] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:27 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:28.101365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:28.103047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:28.110466 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:28.111070 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:28.111731 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:28.112510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:28.113111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:28.113603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:28.252332 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:28.260759 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b833d624-4927-4d0f-bfe0-8185e36453e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.164646 Aug 10 10:07:28.261664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 302/599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:28 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:28.356825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:28.357461 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:28.363924 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:28.364634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:28.365075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:28.365808 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:28.366431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:28.366866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:28.511872 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:28.523412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:28.524809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:28.526184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-be2a5d93-6356-4bc6-b561-ea0b19550688 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.173876 Aug 10 10:07:28.526939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 298/600] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:28 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:29.282939 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:29.284867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:29.287650 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:29.293853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:29.294418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:29.294856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:29.295611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:29.296068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:29.296495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:29.433898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:29.442196 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-79ab5ef5-2586-41a7-8f55-43efa2ecf607 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.163807 Aug 10 10:07:29.454047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 303/601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:29 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:29.550849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:29.551516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:29.557998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:29.558492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:29.558933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:29.559721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:29.560174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:29.560615 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:29.704223 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:29.712716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:29.714219 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:29.715405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-66cb7640-d3f2-4e98-9fd7-7a66209e3a2e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.169664 Aug 10 10:07:29.715976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 299/602] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:29 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:30.466527 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:30.467195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:30.474236 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:30.474723 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:30.475752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:30.476472 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:30.476926 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:30.477562 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:30.613306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:30.621446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e09ff38f-6191-46ca-8934-5503439fb5f7 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.159077 Aug 10 10:07:30.622028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 304/603] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:30 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:30.738750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:30.739358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:30.745802 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:30.746293 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:30.746740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:30.747475 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:30.747938 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:30.748372 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:30.889228 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:30.898505 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:30.900140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:30.901348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-10c5fa05-61fd-4b8b-ae45-e7b558da5f3c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.166581 Aug 10 10:07:30.902599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 300/604] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:30 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:31.645429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:31.646048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:31.652582 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:31.653075 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:31.653515 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:31.654216 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:31.654677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:31.655152 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:31.787438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:31.795761 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d8f69132-df69-4f30-936e-8d9c92cb975a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.154155 Aug 10 10:07:31.796327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 305/605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:31 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:31.924885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:31.925448 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:31.931765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:31.932237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:31.932676 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:31.933370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:31.933828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:31.934261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:32.061767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:32.069998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:32.071549 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:32.072707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5f37722d-6a21-4832-b125-9e3b5f550e84 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.151831 Aug 10 10:07:32.073268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 301/606] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:31 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:32.817758 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:32.818406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:32.825365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:32.825854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:32.826290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:32.826999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:32.827461 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:32.827898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:32.957948 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:32.965902 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c166b8b0-b9a3-4803-8b5e-1b62d0d15fc3 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.152113 Aug 10 10:07:32.966466 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 306/607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:32 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:33.095952 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:33.096572 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:33.103588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:33.104110 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:33.104558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:33.105248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:33.105706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:33.106138 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:33.232450 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:33.241442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:33.242976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:33.244131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4020cbf5-a642-430e-872c-a1a2da8aeb79 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.152047 Aug 10 10:07:33.244687 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 302/608] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:33 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:33.987693 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:33.988308 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:33.995351 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:33.995838 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:33.996280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:33.996968 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:33.997427 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:33.997856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:34.126344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:34.134207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-814324be-e5ba-4cbc-94b9-4c5a5b78c241 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.150377 Aug 10 10:07:34.134769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 307/609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:33 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:34.267174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:34.267719 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:34.274713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:34.275224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:34.275667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:34.276361 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:34.276825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:34.277259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:34.404843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:34.408446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:34.414926 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:34.416499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:34.417670 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a22a428d-609f-48e6-9908-3233bce165a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.154560 Aug 10 10:07:34.418237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 303/610] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:34 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:35.156024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:35.156632 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:35.163737 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:35.164222 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:35.164664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:35.165355 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:35.165814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:35.166240 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:35.186598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:35.294540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:35.302328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-98c44d96-bafe-405f-b128-c1540739147a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.150190 Aug 10 10:07:35.302887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 308/611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:35 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:35.442133 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:35.442707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:35.450124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:35.450614 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:35.451084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:35.451774 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:35.452229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:35.452653 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:35.581805 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:35.590590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:35.593361 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:35.595387 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6552f2c8-eb50-4dac-88a1-324c1992616d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.157419 Aug 10 10:07:35.596414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 304/612] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:35 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:36.324095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:36.324732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:36.331080 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:36.331577 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:36.332021 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:36.332748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:36.333208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:36.333638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:36.461984 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:36.470038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-33e992dc-4d01-41dc-beb3-7a5ffc46074c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.149870 Aug 10 10:07:36.470614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 309/613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:36 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:36.619566 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:36.620183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:36.626801 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:36.627321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:36.627761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:36.628454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:36.628919 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:36.629342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:36.757870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:36.766330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:36.767894 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:36.769145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a5b56425-f9c3-49be-b58c-e5dd39c42344 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.153508 Aug 10 10:07:36.769713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 305/614] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:36 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:37.491912 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:37.492569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:37.498876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:37.499395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:37.499831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:37.500536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:37.501256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:37.501681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:37.627940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:37.636815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-eac8aa90-8080-4662-9e2d-8a065ff66d7c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.148724 Aug 10 10:07:37.637388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 310/615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:37 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:37.793741 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:37.794352 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:37.800995 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:37.801475 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:37.801910 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:37.802596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:37.803587 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:37.804017 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:37.928455 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:37.936822 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:37.938323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:37.939616 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3102b14b-7e97-4dfb-a458-b66c38e3b03b tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.149799 Aug 10 10:07:37.940173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 306/616] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:37 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:38.657765 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:38.658379 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:38.665412 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:38.665845 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:38.666288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:38.666998 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:38.667458 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:38.667891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:38.797834 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:38.805709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d0712e2c-18d9-4f83-be00-0383c44b65e5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.151931 Aug 10 10:07:38.806276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 311/617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:38 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:38.963335 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:38.963905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:38.970398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:38.970882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:38.971358 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:38.972050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:38.972510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:38.972948 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:39.099385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:39.107726 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:39.109236 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:39.110388 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-827c54dc-1322-4d9d-8638-29def6e34f86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.151645 Aug 10 10:07:39.110971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 307/618] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:38 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:39.826814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:39.827452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:39.833809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:39.834894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:39.835354 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:39.836047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:39.836508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:39.836936 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:39.971360 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:39.979272 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ec6b8714-aace-4c10-a167-591a2deb0080 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.156293 Aug 10 10:07:39.979829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 312/619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:39 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:40.134146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:40.134680 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:40.141052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:40.141520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:40.141957 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:40.142644 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:40.143130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:40.143559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:40.274848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:40.283193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:40.284686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:40.285839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ff1686ab-a0b3-4563-b2cc-b2b013b05e86 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.156246 Aug 10 10:07:40.286401 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 308/620] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:40 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:41.000871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:41.001497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:41.008387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:41.008879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:41.009321 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:41.010027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:41.010493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:41.010927 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:41.137710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:41.145666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-260f92b5-dfbc-4713-8f6f-30753829fbab tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.149001 Aug 10 10:07:41.146241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 313/621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:40 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:41.308767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:41.309408 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:41.315771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:41.316260 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:41.316701 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:41.317395 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:41.317857 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:41.318291 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:41.445536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:41.453880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:41.455414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:41.456585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d51cbb2b-e82e-46be-9fe9-95c2faee69d8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.151703 Aug 10 10:07:41.457150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 309/622] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:41 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:42.167148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:42.167772 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:42.174122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:42.174608 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:42.175083 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:42.175778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:42.176245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:42.176673 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:42.303532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:42.311496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2d5ad408-7155-4df0-8808-b158808c0c3a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.148243 Aug 10 10:07:42.312420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 314/623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:42 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:42.482280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:42.482902 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:42.489347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:42.489835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:42.490312 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:42.490984 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:42.491447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:42.491871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:42.622871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:42.631410 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:42.632909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:42.634059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b738aaa2-bc18-4d6f-b55d-724480ebeaff tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.157796 Aug 10 10:07:42.634610 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 310/624] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:42 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:43.333114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:43.333754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:43.340126 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:43.340616 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:43.341062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:43.341758 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:43.342218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:43.342648 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:43.471333 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:43.479818 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fc0cd2c7-d572-4d7f-99b5-e4e65f23e240 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.150544 Aug 10 10:07:43.480381 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 315/625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:43 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:43.657655 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:43.658261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:43.665373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:43.665850 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:43.666282 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:43.666991 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:43.667447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:43.667873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:43.796779 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:43.805777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:43.807309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:43.808459 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0bcbb90a-fcee-42a3-989e-67fba17406b2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.154977 Aug 10 10:07:43.809022 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 311/626] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:43 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:44.461612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-4b8e0de7-1c4a-4c7d-9fb3-3d3d24d003a9 req-0f27584f-c9ba-4874-91ee-076784b6d0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9", "name": "network-vif-plugged", "status": "completed", "tag": "572a9818-c1ee-4385-bd79-7c0a76329a99"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:44.473640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4b8e0de7-1c4a-4c7d-9fb3-3d3d24d003a9 req-0f27584f-c9ba-4874-91ee-076784b6d0d6 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:44.474365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4b8e0de7-1c4a-4c7d-9fb3-3d3d24d003a9 req-0f27584f-c9ba-4874-91ee-076784b6d0d6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:44.475070 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4b8e0de7-1c4a-4c7d-9fb3-3d3d24d003a9 req-0f27584f-c9ba-4874-91ee-076784b6d0d6 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:44.488059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-4b8e0de7-1c4a-4c7d-9fb3-3d3d24d003a9 req-0f27584f-c9ba-4874-91ee-076784b6d0d6 service nova] Creating event network-vif-plugged:572a9818-c1ee-4385-bd79-7c0a76329a99 for instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 on hv-cinder-85083 Aug 10 10:07:44.493168 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-4b8e0de7-1c4a-4c7d-9fb3-3d3d24d003a9 req-0f27584f-c9ba-4874-91ee-076784b6d0d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036117 Aug 10 10:07:44.493774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 316/627] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:44.501871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:44.502482 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:44.509127 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:44.509618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:44.510062 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:44.510759 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:44.511240 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:44.511674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:44.646605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:44.654721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-df40aaa8-6c56-4842-9b15-2688c881ef2d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.156959 Aug 10 10:07:44.655332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 312/628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:44 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:44.831727 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:44.832420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:44.838371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:44.838854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:44.839323 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:44.840011 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:44.840468 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:44.840892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:44.975544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:44.984345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:44.985948 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:44.987252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-75843ed1-c357-46d8-9484-ad8322462614 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.159682 Aug 10 10:07:44.987854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 317/629] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:44 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:45.677229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:45.677849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:45.684337 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:45.684820 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:45.685260 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:45.685947 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:45.686399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:45.686822 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:45.814181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:45.822721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-389fe9ab-406a-46d0-9495-abe83804b54e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1735 microversion: 2.1 time: 0.149374 Aug 10 10:07:45.823317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 313/630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:45 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:46.011510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:46.012049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:46.018368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:46.018852 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:46.019324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:46.020011 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:46.020466 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:46.020891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:46.148171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:46.156366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:46.157870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:46.159044 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-64706112-6767-4223-b66c-3800ee99ae6d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.151472 Aug 10 10:07:46.159593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 318/631] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:46 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:46.844632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:46.845250 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:46.852294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:46.852777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:46.853214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:46.853911 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:46.854357 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:46.854784 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:46.982360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:46.990191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-df6e356d-487f-4220-b8dc-3aad4730215f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1715 microversion: 2.1 time: 0.149526 Aug 10 10:07:46.990976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 314/632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:46 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:47.095542 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:47.096022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:47.102889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.103382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.103816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.104506 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.104987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.105409 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.183781 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:47.184670 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:47.185749 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] HTTP exception thrown: Cannot 'detach_volume' instance 3c63d7ad-f726-40c4-81d9-b7be9492211b while it is in vm_state rescued Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Request method failure captured: Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments/8f57ee3c-f149-4b67-a07a-6e2eff4e8ad9 HTTP/1.1 Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JhpWbH-qE-vLLswXpK03OlT8lk-cXsSH3k7Avifv_u_dOkLQ-2P0_W_annA_hwJh9vgtjslFKTGI8qvokEMcBfB7sxdLJzJo0Cxu82SqjaQdY6y0qLfKf6sqdTLNJqPJPW6QhV5jCYxANMgXAT2F2M3iVogGVjxwuBONtYn366o6w Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:07:47.187388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}] Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: befbca3738f0481296b63c70d6d2a797 Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:07:47.188738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Cannot 'detach_volume' instance 3c63d7ad-f726-40c4-81d9-b7be9492211b while it is in vm_state rescued Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'server_id': '3c63d7ad-f726-40c4-81d9-b7be9492211b', 'id': '8f57ee3c-f149-4b67-a07a-6e2eff4e8ad9'} Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c63d7ad-f726-40c4-81d9-b7be9492211b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:07:47.189452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3c63d7ad-f726-40c4-81d9-b7be9492211b while it is in vm_state rescued Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3c63d7ad-f726-40c4-81d9-b7be9492211b while it is in vm_state rescued Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:07:47.191701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Returning 409 to user: Cannot 'detach_volume' instance 3c63d7ad-f726-40c4-81d9-b7be9492211b while it is in vm_state rescued {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:07:47.194017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0581284b-cabd-4d43-9f4c-a6accb7da7dc tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments/8f57ee3c-f149-4b67-a07a-6e2eff4e8ad9" status: 409 len: 152 microversion: 2.1 time: 0.097321 Aug 10 10:07:47.194017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 319/633] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:07:47 2022] DELETE /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments/8f57ee3c-f149-4b67-a07a-6e2eff4e8ad9 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 10:07:47.200262 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:47.200262 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:47.205970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.206460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.207124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.208095 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.208669 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.208796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.209754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.210187 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.210290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.221523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.222149 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.222666 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.286551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ca32b4bf-1fa1-4ecd-868e-e67213e0e1a6 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "POST /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/action" status: 202 len: 0 microversion: 2.1 time: 0.090267 Aug 10 10:07:47.291136 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 320/634] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:07:47 2022] POST /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:07:47.297475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:47.298276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:47.304638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.305341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.305784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.306495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:47.306973 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:47.307423 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:47.404111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:47.413446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:47.415828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:47.417102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1f936d67-260b-4987-ad5b-a9f04391bfb8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1809 microversion: 2.20 time: 0.237634 Aug 10 10:07:47.417557 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 315/635] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:47 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:07:47.477201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:47.485369 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ae1ead3f-6315-4e28-90d8-cd26c54d3b05 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1723 microversion: 2.1 time: 0.191890 Aug 10 10:07:47.485935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 321/636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:47 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:48.440567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:48.441203 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:48.448277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:48.448760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:48.449199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:48.449881 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:48.450334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:48.450761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:48.508087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:48.508693 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:48.515051 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:48.515542 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:48.515980 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:48.516673 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:48.517126 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:48.517551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:48.616628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:48.625131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:48.626900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:48.628093 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c0242825-59ae-4b27-9ea4-ed76a1a7d34f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1796 microversion: 2.20 time: 0.191411 Aug 10 10:07:48.628664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 316/637] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:07:48 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1796 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:07:48.660674 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:48.669325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-528acf6e-ee91-413d-bde7-974153721d1f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1723 microversion: 2.1 time: 0.165617 Aug 10 10:07:48.669887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 322/638] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:48 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:07:49.690676 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:49.691233 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:49.697716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:49.698202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:49.698641 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:49.699356 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:49.699814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:49.700241 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:49.833068 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:49.841652 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a2003ea4-f101-4e91-bdb8-7baefbd76059 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1723 microversion: 2.1 time: 0.154895 Aug 10 10:07:49.842227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 317/639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:49 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:50.864049 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:50.864598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:50.871429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:50.871909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:50.872345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:50.873029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:50.873484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:50.873911 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:51.001205 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:07:51.009145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6fbce149-4f3c-476d-8613-2440a7c91eac tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1729 microversion: 2.1 time: 0.149066 Aug 10 10:07:51.009702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 323/640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:07:50 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:07:51.029371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:07:51.029886 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:07:51.036306 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:51.036791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:51.037734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:51.038421 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:51.038881 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:51.039345 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:51.116992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e3ecd72c-58fc-494b-853c-9b475f9f482a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091468 Aug 10 10:07:51.117590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 318/641] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:07:51 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:51.981925 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-b9b0971c-da67-478e-8a3b-8b5a01607517 req-3a4e6e15-05e6-4198-a10f-8db97f418937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c63d7ad-f726-40c4-81d9-b7be9492211b", "tag": "887e207d-4c97-4327-ac8a-a5e5d6d83824"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:51.992592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-b9b0971c-da67-478e-8a3b-8b5a01607517 req-3a4e6e15-05e6-4198-a10f-8db97f418937 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:51.993116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-b9b0971c-da67-478e-8a3b-8b5a01607517 req-3a4e6e15-05e6-4198-a10f-8db97f418937 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:51.993571 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-b9b0971c-da67-478e-8a3b-8b5a01607517 req-3a4e6e15-05e6-4198-a10f-8db97f418937 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:52.006354 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-b9b0971c-da67-478e-8a3b-8b5a01607517 req-3a4e6e15-05e6-4198-a10f-8db97f418937 service nova] Creating event network-changed:887e207d-4c97-4327-ac8a-a5e5d6d83824 for instance 3c63d7ad-f726-40c4-81d9-b7be9492211b on hv-cinder-85083 Aug 10 10:07:52.011619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-b9b0971c-da67-478e-8a3b-8b5a01607517 req-3a4e6e15-05e6-4198-a10f-8db97f418937 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034352 Aug 10 10:07:52.012277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 324/642] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:07:54.027191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-c604cfdb-60ce-4f8a-bb04-daa4e2606564 req-f2134199-f2c9-4687-aadb-d728d7cfd426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c63d7ad-f726-40c4-81d9-b7be9492211b", "tag": "887e207d-4c97-4327-ac8a-a5e5d6d83824"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:07:54.036970 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c604cfdb-60ce-4f8a-bb04-daa4e2606564 req-f2134199-f2c9-4687-aadb-d728d7cfd426 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:07:54.037538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c604cfdb-60ce-4f8a-bb04-daa4e2606564 req-f2134199-f2c9-4687-aadb-d728d7cfd426 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:07:54.038010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-c604cfdb-60ce-4f8a-bb04-daa4e2606564 req-f2134199-f2c9-4687-aadb-d728d7cfd426 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:07:54.049201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-c604cfdb-60ce-4f8a-bb04-daa4e2606564 req-f2134199-f2c9-4687-aadb-d728d7cfd426 service nova] Creating event network-changed:887e207d-4c97-4327-ac8a-a5e5d6d83824 for instance 3c63d7ad-f726-40c4-81d9-b7be9492211b on hv-cinder-85083 Aug 10 10:07:54.054376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-c604cfdb-60ce-4f8a-bb04-daa4e2606564 req-f2134199-f2c9-4687-aadb-d728d7cfd426 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031754 Aug 10 10:07:54.055209 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 319/643] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:02.527734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=43 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:02.528467 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:02.532574 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-779934427"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:02.533200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:02.541209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:02.541702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:02.542142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:02.542835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:02.543328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:02.543760 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:02.723921 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.network.security_group_api [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Removing security group 3c7f33b9-58ca-4b46-bcd2-03efa08b5102 from port 72577d9b-8949-4110-8e7a-5678ee2987d0 Aug 10 10:08:03.253989 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-99027a42-f635-4c46-8130-dca02f1d2c1d tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/action" status: 202 len: 0 microversion: 2.1 time: 0.727937 Aug 10 10:08:03.259449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 325/644] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:08:02 2022] POST /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/action => generated 0 bytes in 734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:08:03.266472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-aee06943-0027-4e2c-bc0d-80963042c027 req-cf7b658f-ed53-417b-83ad-f427b9a19450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3acf77a6-2970-4d9a-aee8-46e37fe3a0bb", "tag": "72577d9b-8949-4110-8e7a-5678ee2987d0"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:03.275735 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=50 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:03.283370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-aee06943-0027-4e2c-bc0d-80963042c027 req-cf7b658f-ed53-417b-83ad-f427b9a19450 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:03.283789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-aee06943-0027-4e2c-bc0d-80963042c027 req-cf7b658f-ed53-417b-83ad-f427b9a19450 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:03.284334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-aee06943-0027-4e2c-bc0d-80963042c027 req-cf7b658f-ed53-417b-83ad-f427b9a19450 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:03.297289 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-aee06943-0027-4e2c-bc0d-80963042c027 req-cf7b658f-ed53-417b-83ad-f427b9a19450 service nova] Creating event network-changed:72577d9b-8949-4110-8e7a-5678ee2987d0 for instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb on hv-cinder-85083 Aug 10 10:08:03.304010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-aee06943-0027-4e2c-bc0d-80963042c027 req-cf7b658f-ed53-417b-83ad-f427b9a19450 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042666 Aug 10 10:08:03.304951 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 320/645] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:04.488719 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:04.489258 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:04.495878 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:04.496413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:04.496884 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:04.497617 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:04.498103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:04.498558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:04.580449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lazy-loading 'services' on Instance uuid 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:04.657377 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2526376a-c872-4f8f-960a-d4a4b5fbbc52 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments/2479429f-1e57-4606-8b2c-fb5bbf4d1965" status: 202 len: 0 microversion: 2.1 time: 0.172940 Aug 10 10:08:04.657972 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 326/646] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:08:04 2022] DELETE /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments/2479429f-1e57-4606-8b2c-fb5bbf4d1965 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:08:04.667484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:04.670783 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:04.677022 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:04.677626 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:04.678084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:04.678918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:04.679558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:04.679998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:04.711554 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1f101677-b9a6-4436-a609-fedaa8bcb00f tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048886 Aug 10 10:08:04.712300 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 321/647] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:08:04 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:05.319764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-06464ff7-6922-4c41-b0ee-48744df6ab9c req-170bb550-4449-4956-879f-ee4b82d45d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3acf77a6-2970-4d9a-aee8-46e37fe3a0bb", "tag": "72577d9b-8949-4110-8e7a-5678ee2987d0"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:05.329722 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-06464ff7-6922-4c41-b0ee-48744df6ab9c req-170bb550-4449-4956-879f-ee4b82d45d91 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:05.330425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-06464ff7-6922-4c41-b0ee-48744df6ab9c req-170bb550-4449-4956-879f-ee4b82d45d91 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:05.330857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-06464ff7-6922-4c41-b0ee-48744df6ab9c req-170bb550-4449-4956-879f-ee4b82d45d91 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:05.341985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-06464ff7-6922-4c41-b0ee-48744df6ab9c req-170bb550-4449-4956-879f-ee4b82d45d91 service nova] Creating event network-changed:72577d9b-8949-4110-8e7a-5678ee2987d0 for instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb on hv-cinder-85083 Aug 10 10:08:05.355501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-06464ff7-6922-4c41-b0ee-48744df6ab9c req-170bb550-4449-4956-879f-ee4b82d45d91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035849 Aug 10 10:08:05.356252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 327/648] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:05.725186 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:05.727343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:05.734041 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:05.734540 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:05.735013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:05.735727 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:05.736187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:05.736640 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:05.739676 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=99 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:05.767769 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e6b592e6-830f-451b-add6-7ebe69217eb7 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047284 Aug 10 10:08:05.768363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 322/649] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:08:05 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:08:05.781627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:05.782543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:05.790036 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:05.790633 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:05.791193 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:05.791969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:05.792530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:05.793028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:05.868441 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] HTTP exception thrown: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb is not attached to volume 2479429f-1e57-4606-8b2c-fb5bbf4d1965 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Request method failure captured: Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments/2479429f-1e57-4606-8b2c-fb5bbf4d1965 HTTP/1.1 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84KzxdCnodIlyKR9PDcM3eEXnGCa5Oz7SZntEOWf5qvkwQ3DIzSefe0L47SDz84vbbo0XbXs3HAWWX3vsAjDmvn4Y3o2v_UfeaJbBBN3HHIq8JPXj2ltnpg5UoN-i5q3K981P2i2ChgUxKdjxLFgDXEd6AneBGgTvvwE1r1s0Spn5c8 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 281a4bf45d474217a84a31cee8128a87 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-TestMinimumBasicScenario-1879677070 Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:08:05.878330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/281a4bf45d474217a84a31cee8128a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/281a4bf45d474217a84a31cee8128a87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_281a4bf45d474217a84a31cee8128a87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/281a4bf45d474217a84a31cee8128a87"}]}] Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-TestMinimumBasicScenario-1879677070 Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 281a4bf45d474217a84a31cee8128a87 Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1879677070 Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-TestMinimumBasicScenario-1879677070-project Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: e9b57c80a45a454680de3e69db92c6cc Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-TestMinimumBasicScenario-1879677070-project Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:08:05.879997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb is not attached to volume 2479429f-1e57-4606-8b2c-fb5bbf4d1965 Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'server_id': '3acf77a6-2970-4d9a-aee8-46e37fe3a0bb', 'id': '2479429f-1e57-4606-8b2c-fb5bbf4d1965'} Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2479429f-1e57-4606-8b2c-fb5bbf4d1965. Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:05.881174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb is not attached to volume 2479429f-1e57-4606-8b2c-fb5bbf4d1965 Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb is not attached to volume 2479429f-1e57-4606-8b2c-fb5bbf4d1965 Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:05.882645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Returning 404 to user: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb is not attached to volume 2479429f-1e57-4606-8b2c-fb5bbf4d1965 {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:05.884120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4f698623-a7dd-4c78-a697-f94bca9e59d9 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments/2479429f-1e57-4606-8b2c-fb5bbf4d1965" status: 404 len: 154 microversion: 2.1 time: 0.103369 Aug 10 10:08:05.884120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 328/650] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:08:05 2022] DELETE /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb/os-volume_attachments/2479429f-1e57-4606-8b2c-fb5bbf4d1965 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:08:06.915833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:06.916399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:06.922633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:06.923146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:06.923584 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:06.924271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:06.924725 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:06.925151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:06.947826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3033646a-804c-4a36-a760-e33bf8f4f8d6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/ips" status: 200 len: 149 microversion: 2.1 time: 0.036366 Aug 10 10:08:06.948384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 323/651] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:08:06 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:07.019322 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:07.019819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:07.026576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:07.027123 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:07.028073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:07.028225 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:07.028639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:07.029072 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:07.055585 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:08:07.132620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6cae7bd9-2695-4470-9461-7fa3ce4e2e37 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 204 len: 0 microversion: 2.1 time: 0.116812 Aug 10 10:08:07.133597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 329/652] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:08:07 2022] DELETE /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:08:07.142058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:07.142638 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:07.149117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:07.149621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:07.150119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:07.150894 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:07.151377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:07.152139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:07.341169 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:07.348574 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2d2ed42e-2b5e-4877-8d2f-c6cda751af29 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1555 microversion: 2.1 time: 0.210495 Aug 10 10:08:07.349788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 324/653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:07 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1555 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:08.299195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73856605-19be-4f86-bb77-526ca0815a0f"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:08.301612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:08.307943 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:08.308444 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:08.308892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:08.309591 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:08.310057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:08.310497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:08.369544 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:08.370165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:08.377217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:08.377743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:08.378183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:08.378873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:08.379356 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:08.379784 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:08.506689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:08.514087 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-507b1c1e-d547-44fa-b5b7-3988009ea3f8 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1555 microversion: 2.1 time: 0.148276 Aug 10 10:08:08.514656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 325/654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:08 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:08.947997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-798b823f-4773-48aa-a7ab-6661d880c097 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652932 Aug 10 10:08:08.948628 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 330/655] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:08:08 2022] POST /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:09.544952 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:09.546170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:09.557427 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:09.558218 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:09.558654 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:09.559714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:09.560179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:09.560607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:09.597426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-618244a8-379d-4263-9259-d1e349970ffe req-5474f6a9-9333-4bb9-8042-9895beecaf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3acf77a6-2970-4d9a-aee8-46e37fe3a0bb", "name": "network-vif-deleted", "tag": "72577d9b-8949-4110-8e7a-5678ee2987d0"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:09.609543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-618244a8-379d-4263-9259-d1e349970ffe req-5474f6a9-9333-4bb9-8042-9895beecaf52 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:09.609987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-618244a8-379d-4263-9259-d1e349970ffe req-5474f6a9-9333-4bb9-8042-9895beecaf52 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:09.610428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-618244a8-379d-4263-9259-d1e349970ffe req-5474f6a9-9333-4bb9-8042-9895beecaf52 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:09.624269 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-618244a8-379d-4263-9259-d1e349970ffe req-5474f6a9-9333-4bb9-8042-9895beecaf52 service nova] Creating event network-vif-deleted:72577d9b-8949-4110-8e7a-5678ee2987d0 for instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb on hv-cinder-85083 Aug 10 10:08:09.629658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-618244a8-379d-4263-9259-d1e349970ffe req-5474f6a9-9333-4bb9-8042-9895beecaf52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036703 Aug 10 10:08:09.630838 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 331/656] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:09.634793 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9b57c80a45a454680de3e69db92c6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281a4bf45d474217a84a31cee8128a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:09.644701 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1622700f-4cba-4193-85a1-58bab9a71f64 tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 200 len: 1513 microversion: 2.1 time: 0.112533 Aug 10 10:08:09.655399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 326/657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:09 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 1513 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:10.667786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:10.668432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] [instance: 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:10.674521 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:10.675031 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:10.675475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:10.676168 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:10.676637 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:10.677136 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:10.690023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] HTTP exception thrown: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb could not be found. Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Request method failure captured: Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb HTTP/1.1 Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84KzxdCnodIlyKR9PDcM3eEXnGCa5Oz7SZntEOWf5qvkwQ3DIzSefe0L47SDz84vbbo0XbXs3HAWWX3vsAjDmvn4Y3o2v_UfeaJbBBN3HHIq8JPXj2ltnpg5UoN-i5q3K981P2i2ChgUxKdjxLFgDXEd6AneBGgTvvwE1r1s0Spn5c8 Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 281a4bf45d474217a84a31cee8128a87 Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-TestMinimumBasicScenario-1879677070 Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:08:10.691639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/281a4bf45d474217a84a31cee8128a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/281a4bf45d474217a84a31cee8128a87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_281a4bf45d474217a84a31cee8128a87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/281a4bf45d474217a84a31cee8128a87"}]}] Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-TestMinimumBasicScenario-1879677070 Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 281a4bf45d474217a84a31cee8128a87 Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1879677070 Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-TestMinimumBasicScenario-1879677070-project Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: e9b57c80a45a454680de3e69db92c6cc Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-TestMinimumBasicScenario-1879677070-project Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb could not be found. Aug 10 10:08:10.693626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '3acf77a6-2970-4d9a-aee8-46e37fe3a0bb'} Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb could not be found. Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:10.694495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb could not be found. Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb could not be found. Aug 10 10:08:10.695893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:10.697134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Returning 404 to user: Instance 3acf77a6-2970-4d9a-aee8-46e37fe3a0bb could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:10.697134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3270572e-d8a4-432c-871a-1c286e47a90e tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb" status: 404 len: 111 microversion: 2.1 time: 0.030583 Aug 10 10:08:10.697134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 332/658] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:10 2022] GET /compute/v2.1/servers/3acf77a6-2970-4d9a-aee8-46e37fe3a0bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:08:10.703376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7ae10bf8-4488-4835-9a73-7764d2e462bb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] Calling method '.version_select at 0x7f22fbd8f0d0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:10.724037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7ae10bf8-4488-4835-9a73-7764d2e462bb tempest-TestMinimumBasicScenario-1879677070 tempest-TestMinimumBasicScenario-1879677070-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1038842877" status: 202 len: 0 microversion: 2.1 time: 0.024384 Aug 10 10:08:10.724671 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 327/659] 10.222.0.20 () {58 vars in 1272 bytes} [Wed Aug 10 10:08:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1038842877 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:08:15.584850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73856605-19be-4f86-bb77-526ca0815a0f"}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:15.587196 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:15.596725 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:15.597210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:15.597665 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:15.598347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:15.599637 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:15.600069 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:15.691751 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Invalid volume: volume 73856605-19be-4f86-bb77-526ca0815a0f is already attached to instances: c6a806be-ce2e-41ba-bcac-a3934f0addc8 Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: POST /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments HTTP/1.1 Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 74 Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:08:15.693547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {"volumeAttachment": {"volumeId": "73856605-19be-4f86-bb77-526ca0815a0f"}} Aug 10 10:08:15.695133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Invalid volume: volume 73856605-19be-4f86-bb77-526ca0815a0f is already attached to instances: c6a806be-ce2e-41ba-bcac-a3934f0addc8 Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'server_id': 'c6a806be-ce2e-41ba-bcac-a3934f0addc8', 'body': {'volumeAttachment': {'volumeId': '73856605-19be-4f86-bb77-526ca0815a0f'}}} Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73856605-19be-4f86-bb77-526ca0815a0f is already attached to instances: c6a806be-ce2e-41ba-bcac-a3934f0addc8 Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:15.696006 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73856605-19be-4f86-bb77-526ca0815a0f is already attached to instances: c6a806be-ce2e-41ba-bcac-a3934f0addc8 Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:15.697338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73856605-19be-4f86-bb77-526ca0815a0f is already attached to instances: c6a806be-ce2e-41ba-bcac-a3934f0addc8 Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 400 to user: Invalid volume: volume 73856605-19be-4f86-bb77-526ca0815a0f is already attached to instances: c6a806be-ce2e-41ba-bcac-a3934f0addc8 {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bba30ca4-e2c4-4592-8bb7-097e7fd2c13e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114722 Aug 10 10:08:15.698753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 333/660] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:08:15 2022] POST /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 10:08:15.766666 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:15.767226 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:15.776592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:15.777130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:15.777804 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:15.778681 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:15.779326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:15.779760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:15.860879 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lazy-loading 'services' on Instance uuid c6a806be-ce2e-41ba-bcac-a3934f0addc8 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:15.935438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b6eaaaea-8785-4e85-a09e-b0dee3a59862 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments/73856605-19be-4f86-bb77-526ca0815a0f" status: 202 len: 0 microversion: 2.1 time: 0.173283 Aug 10 10:08:15.936087 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 328/661] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:08:15 2022] DELETE /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments/73856605-19be-4f86-bb77-526ca0815a0f => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:08:15.945528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:15.948016 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:15.956237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:15.957432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:15.957880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:15.958644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:15.959131 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:15.959720 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:16.003453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e1c8f11e-a6b2-47f0-a962-ba4fab0324ec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062274 Aug 10 10:08:16.004233 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 334/662] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:08:15 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:17.017746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:17.021999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:17.028711 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:17.029349 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:17.029909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:17.030715 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:17.031298 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:17.031873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:17.063734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-654d3226-1c49-40b4-849b-c3d816d2b30b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051309 Aug 10 10:08:17.064484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 329/663] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:08:17 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:08:17.132367 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:17.133210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:17.143111 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:17.143749 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:17.144481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:17.145202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:17.145666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:17.146094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:17.175998 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:08:17.265048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-364e040e-0424-44e9-ac92-17a398f1e09d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 204 len: 0 microversion: 2.1 time: 0.136998 Aug 10 10:08:17.266229 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 335/664] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:08:17 2022] DELETE /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:08:17.277039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:17.277970 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:17.289823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:17.290299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:17.290771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:17.293126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:17.293606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:17.294085 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:17.434365 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:17.442298 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-73088a49-61ee-42d1-89ed-f19a390db890 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1679 microversion: 2.1 time: 0.171368 Aug 10 10:08:17.443008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 330/665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:17 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:18.464297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:18.464997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:18.471402 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:18.471897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:18.472334 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:18.473030 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:18.473481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:18.473903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:18.647613 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:18.655746 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-330f05be-90c6-4924-b607-30d3126b544f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1679 microversion: 2.1 time: 0.195844 Aug 10 10:08:18.656644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 336/666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:18 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:19.680993 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:19.682066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:19.691158 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:19.691811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:19.693236 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:19.694107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:19.694709 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:19.695489 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:20.169119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:20.187623 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f8d4f649-963f-4c56-b41c-0c4197bda987 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 200 len: 1679 microversion: 2.1 time: 0.511271 Aug 10 10:08:20.191034 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 331/667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:19 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 1679 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:20.531808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-4f6afa95-257d-4ecb-9c50-7c4478899d9d req-2437871c-13a9-4067-8a94-3e2ddf7e7655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a806be-ce2e-41ba-bcac-a3934f0addc8", "name": "network-vif-deleted", "tag": "3c234633-ee96-48cb-91d9-44a20cdd20a2"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:20.544138 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4f6afa95-257d-4ecb-9c50-7c4478899d9d req-2437871c-13a9-4067-8a94-3e2ddf7e7655 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:20.545057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4f6afa95-257d-4ecb-9c50-7c4478899d9d req-2437871c-13a9-4067-8a94-3e2ddf7e7655 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:20.545879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-4f6afa95-257d-4ecb-9c50-7c4478899d9d req-2437871c-13a9-4067-8a94-3e2ddf7e7655 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:20.561569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-4f6afa95-257d-4ecb-9c50-7c4478899d9d req-2437871c-13a9-4067-8a94-3e2ddf7e7655 service nova] Creating event network-vif-deleted:3c234633-ee96-48cb-91d9-44a20cdd20a2 for instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 on hv-cinder-85083 Aug 10 10:08:20.568858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-4f6afa95-257d-4ecb-9c50-7c4478899d9d req-2437871c-13a9-4067-8a94-3e2ddf7e7655 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040574 Aug 10 10:08:20.573764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 337/668] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:21.216177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:21.216803 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:21.225531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:21.226027 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:21.226471 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:21.227292 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:21.227762 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:21.228197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:21.246632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 HTTP/1.1 Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:08:21.249002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:08:21.250580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'c6a806be-ce2e-41ba-bcac-a3934f0addc8'} Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:21.251717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:08:21.253207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:08:21.255582 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:21.256716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-01133b9d-e600-4b73-9057-3088cec5f428 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 404 len: 111 microversion: 2.1 time: 0.044470 Aug 10 10:08:21.259472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 332/669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:21 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:08:21.270800 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6acae7bc-dc40-40a4-8919-8c6068f1834c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '.version_select at 0x7f22fbfec4c0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:21.294248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6acae7bc-dc40-40a4-8919-8c6068f1834c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418367340" status: 202 len: 0 microversion: 2.1 time: 0.031747 Aug 10 10:08:21.298174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 338/670] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 10 10:08:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1418367340 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:08:22.119895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-26e3ffd3-b055-40f2-97f0-10af509e3cf9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: .version_select at 0x7f22fbd48820>, body: {"keypair": {"name": "tempest-keypair-1720786773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8gV4Sc62+7eQgLoKO8PMs7JMZsOSfhl9PowC/Aey8IC0LLRztdsEPRbV/HE8BB8t0DnhtJPgMbUw0WMBB9C7kSzM5YRGFDsza977J7gtfFxBstzHYmUIR6vyAlmpwqVA=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:22.138431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-26e3ffd3-b055-40f2-97f0-10af509e3cf9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:08:22.142536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-26e3ffd3-b055-40f2-97f0-10af509e3cf9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:08:22.170242 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-26e3ffd3-b055-40f2-97f0-10af509e3cf9 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054842 Aug 10 10:08:22.170910 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 333/671] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:08:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:23.908283 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1258169441", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0883fa82-bc1b-403f-a6c6-d9e718def253"}], "security_groups": [{"name": "tempest-securitygroup--852525658"}], "key_name": "tempest-keypair-1720786773", "user_data": "}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:24.090218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.network.neutron [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] validate_networks() for [('0883fa82-bc1b-403f-a6c6-d9e718def253', None, None, None, None, None)] {{(pid=117895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:08:24.787330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:08:24.788122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:08:24.788595 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Flavor pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:08:24.789201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Image pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:08:24.789794 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:08:24.799254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:24.799953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:24.800544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:24.801514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:24.802265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:24.802696 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:24.826349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:08:24.834128 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Getting quotas for user 2dd3653b931643318f1a1b0820620277 and project 66439eb22e4a4938b0522bfd356ca3f9. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:08:24.846087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Going to run 1 instances... {{(pid=117895) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:08:24.848546 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:08:24.900438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ccbf88dd-64ec-4780-a911-af71885c1421 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.997716 Aug 10 10:08:24.907143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 339/672] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:08:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:08:24.912763 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d4830cb9-7da3-4e66-bd71-9c9684547542 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:24.913385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d4830cb9-7da3-4e66-bd71-9c9684547542 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:24.984099 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d4830cb9-7da3-4e66-bd71-9c9684547542 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:24.991152 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d4830cb9-7da3-4e66-bd71-9c9684547542 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1242 microversion: 2.1 time: 0.082698 Aug 10 10:08:24.991723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 334/673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:24 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:26.015331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:26.017299 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:26.040743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:26.041452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:26.042457 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:26.043234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:26.043963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:26.044404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:26.200879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:26.206599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:26.219081 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6e3b6117-bf73-4f6e-89ad-8e00197003d5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1302 microversion: 2.1 time: 0.209532 Aug 10 10:08:26.219716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 340/674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:26 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1302 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:27.245412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:27.246537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:27.254851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:27.255752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:27.257110 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:27.258190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:27.259375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:27.260323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:27.842988 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:27.861341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-184f37fe-7524-436f-ad4e-0d5077bd754b tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.622952 Aug 10 10:08:27.862033 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 335/675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:27 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:27.908922 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-2dc4ab67-2b3f-4eac-a4dd-1172561c2675 req-e1e421eb-cccd-4bc5-b995-19d2117d04a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6cb556-324b-440d-98cd-2532ad4cdc93", "tag": "0c4c8fd5-8820-40b7-802d-7b3e43f17440"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:27.925454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:27.927454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:27.942832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:27.946810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:27.948160 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:27.956874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-2dc4ab67-2b3f-4eac-a4dd-1172561c2675 req-e1e421eb-cccd-4bc5-b995-19d2117d04a7 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:27.957487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:27.958082 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:27.958590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:27.960994 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-2dc4ab67-2b3f-4eac-a4dd-1172561c2675 req-e1e421eb-cccd-4bc5-b995-19d2117d04a7 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:27.961807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-2dc4ab67-2b3f-4eac-a4dd-1172561c2675 req-e1e421eb-cccd-4bc5-b995-19d2117d04a7 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:27.978971 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-2dc4ab67-2b3f-4eac-a4dd-1172561c2675 req-e1e421eb-cccd-4bc5-b995-19d2117d04a7 service nova] Creating event network-changed:0c4c8fd5-8820-40b7-802d-7b3e43f17440 for instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 on hv-cinder-85083 Aug 10 10:08:27.985009 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-2dc4ab67-2b3f-4eac-a4dd-1172561c2675 req-e1e421eb-cccd-4bc5-b995-19d2117d04a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079721 Aug 10 10:08:27.987126 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 341/676] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:08:28.012805 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a148a203-7460-4d0f-ab8c-e10f45784496 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments/3e6047cb-050a-4fa6-a14d-5e36b6ac5f65" status: 200 len: 194 microversion: 2.20 time: 0.091333 Aug 10 10:08:28.013398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 336/677] 10.222.0.20 () {60 vars in 1454 bytes} [Wed Aug 10 10:08:27 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments/3e6047cb-050a-4fa6-a14d-5e36b6ac5f65 => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 10:08:28.098101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:28.099329 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:28.107483 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:28.107991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:28.109177 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:28.110145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:28.111404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:28.112192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:28.249597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lazy-loading 'services' on Instance uuid bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:28.392767 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a7526f70-0d22-4192-a3ed-eb9ee65d6f32 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments/3e6047cb-050a-4fa6-a14d-5e36b6ac5f65" status: 202 len: 0 microversion: 2.20 time: 0.298834 Aug 10 10:08:28.393374 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 342/678] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Aug 10 10:08:28 2022] DELETE /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments/3e6047cb-050a-4fa6-a14d-5e36b6ac5f65 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:08:28.415170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:28.417567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:28.439630 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:28.440398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:28.440999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:28.441878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:28.443038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:28.446496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:28.503656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c077c1ed-8981-45a1-9acf-a8d62e9ad04c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.101582 Aug 10 10:08:28.511309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 337/679] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 10 10:08:28 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:08:28.885840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:28.887558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:28.907181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:28.908116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:28.908785 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:28.909758 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:28.915253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:28.916030 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:29.115867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:29.124933 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9d822e8d-28d4-4485-87e6-52fe7acd9fec tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.245672 Aug 10 10:08:29.143468 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 343/680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:28 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:29.523285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:29.528343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:29.539708 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:29.541939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:29.542618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:29.543615 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:29.544515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:29.545212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:29.593189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-79e32278-8b4a-410d-87a7-3c02cf6fe2c2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075006 Aug 10 10:08:29.599613 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 338/681] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 10 10:08:29 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:08:30.147794 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:30.148411 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:30.154821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.155370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.155818 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:30.156596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.157064 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.157501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:30.336138 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:30.344569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ae1b2a96-d937-4802-b050-f2ec068657fe tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.201277 Aug 10 10:08:30.345274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 344/682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:30 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:30.608184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:30.611102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:30.618810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.619851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.620525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:30.621513 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.622222 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.622849 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:30.665752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-56b6aacb-aa4b-4bc4-8918-bf7560e64c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062407 Aug 10 10:08:30.667093 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 339/683] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 10 10:08:30 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:30.760842 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:30.761439 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:30.767859 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.768359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.768803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:30.769906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.771832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.772456 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:30.802174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:08:30.936347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dfe605e5-fd6d-4ddc-adb7-38fc941020b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 204 len: 0 microversion: 2.20 time: 0.179209 Aug 10 10:08:30.939055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 345/684] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 10 10:08:30 2022] DELETE /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 10:08:30.955293 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:30.956162 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:30.970088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.970785 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.972887 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:30.974384 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:30.976785 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:30.978628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:31.150227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:31.160057 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:31.163894 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:31.165456 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f263a3e6-843f-4e2a-a8bf-43030c00ba21 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.223616 Aug 10 10:08:31.166352 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 340/685] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:30 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:31.185388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:31.185905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:31.192252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:31.192747 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:31.193191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:31.193887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:31.194349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:31.194784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:31.303012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lazy-loading 'services' on Instance uuid 3c63d7ad-f726-40c4-81d9-b7be9492211b {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:31.368286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:31.370063 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:31.378852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:31.379808 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:31.381564 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:31.382799 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:31.383481 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:31.384520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:31.393203 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e3eafcab-207b-4bc5-8d0b-cc7b4510843a tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments/8f57ee3c-f149-4b67-a07a-6e2eff4e8ad9" status: 202 len: 0 microversion: 2.1 time: 0.211868 Aug 10 10:08:31.393959 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 346/686] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:08:31 2022] DELETE /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments/8f57ee3c-f149-4b67-a07a-6e2eff4e8ad9 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:08:31.404022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:31.407088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:31.415104 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:31.415814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:31.416478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:31.417196 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:31.417664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:31.418100 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:31.452271 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5346a721-b140-4d98-8ab2-ea88b3f52cd5 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053265 Aug 10 10:08:31.453177 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 347/687] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:08:31 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:08:31.537006 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:31.545279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-164a9f41-c7f2-4662-8937-f0567b60a21e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.183032 Aug 10 10:08:31.545861 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 341/688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:31 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:31.621556 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-90a2f0ca-fe8c-4caa-89ff-d8fe3ec8b327 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Action: 'create', calling method: .version_select at 0x7f22fbe579d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1577537931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEXvoi1qZhFBoOhirQvrnraNF0a7TNmicKq6HIXAneBwtCs3nZHI/rqgqGVXER6yq1Dqsxv9qrwpsLagI8WjznsnM4pGWx4Xp3u6g4VkjsUXgswRRyxWoMPLTbnHdH/UQ=="}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:31.637035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-90a2f0ca-fe8c-4caa-89ff-d8fe3ec8b327 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Getting quotas for project cdaf00b54b894a9db2de21ff1ef475a2. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:08:31.641425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-90a2f0ca-fe8c-4caa-89ff-d8fe3ec8b327 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Getting quotas for user 26782775a52b48e9a9a84d64d28ceca0 and project cdaf00b54b894a9db2de21ff1ef475a2. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:08:31.663504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-90a2f0ca-fe8c-4caa-89ff-d8fe3ec8b327 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.209127 Aug 10 10:08:31.664106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 348/689] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:08:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:32.189949 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:32.190585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:32.198592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:32.198972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:32.199421 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:32.203856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:32.204345 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:32.204794 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:32.234971 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:32.403418 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:32.420791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:32.422634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:32.423916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dab5c516-7ad2-4a87-90d1-98bc89139816 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1724 microversion: 2.20 time: 0.238036 Aug 10 10:08:32.437256 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 342/690] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:32 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:32.465857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:32.468631 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:32.478113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:32.478619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:32.479094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:32.479822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:32.480478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:32.480925 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:32.514855 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3276c5f2-175b-4170-8c37-e97b3515631e tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054053 Aug 10 10:08:32.515802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 349/691] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:08:32 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:32.581722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:32.586179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:32.613383 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:32.613901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:32.614368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:32.615359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:32.615834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:32.616511 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:32.827547 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:32.836998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3de3e86f-8210-4b2d-b1d3-d3a04aa0625f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.273426 Aug 10 10:08:32.837859 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 343/692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:32 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:33.450999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:33.451826 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:33.455850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:33.471706 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.472295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.472641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:33.473359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.475940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.476420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:33.527327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:33.530648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:33.533282 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:33.545406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.553115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.554187 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:33.556300 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.557498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.558212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:33.574093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:33.582625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:33.584183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:33.585406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b5c3c163-ff12-4b53-bd23-eccce900aa5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1656 microversion: 2.20 time: 0.139112 Aug 10 10:08:33.585908 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 350/693] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:33 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1656 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:33.618332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-984ae807-dc82-46c5-87dc-783ab3ee7380 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095103 Aug 10 10:08:33.618924 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 344/694] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:08:33 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 10:08:33.737459 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:33.738102 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:33.752359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.754821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.755394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:33.760165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.760643 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.761113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:33.815462 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:08:33.858677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:33.859689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:33.872770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.876324 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.876908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:33.887335 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:33.888205 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:33.888771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.037078 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1531c5ea-79a2-403b-a5c5-abb45653f84f tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 204 len: 0 microversion: 2.1 time: 0.305172 Aug 10 10:08:34.038278 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 351/695] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:08:33 2022] DELETE /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:08:34.117274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:34.128946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-447ba0fe-e028-4605-adaa-66fdc8cba7b2 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.274049 Aug 10 10:08:34.130115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 345/696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:33 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:34.135284 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:34.137031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:34.144073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:34.144824 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:34.145464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.146352 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:34.146989 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:34.147574 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.168002 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-79c5cd27-10fb-4f62-a569-c32824d29f54 req-fbc04a92-0489-4746-9da3-8dc7e2cc87f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9", "name": "network-vif-deleted", "tag": "572a9818-c1ee-4385-bd79-7c0a76329a99"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:34.185207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-79c5cd27-10fb-4f62-a569-c32824d29f54 req-fbc04a92-0489-4746-9da3-8dc7e2cc87f1 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:34.185998 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-79c5cd27-10fb-4f62-a569-c32824d29f54 req-fbc04a92-0489-4746-9da3-8dc7e2cc87f1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:34.186611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-79c5cd27-10fb-4f62-a569-c32824d29f54 req-fbc04a92-0489-4746-9da3-8dc7e2cc87f1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.207887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-79c5cd27-10fb-4f62-a569-c32824d29f54 req-fbc04a92-0489-4746-9da3-8dc7e2cc87f1 service nova] Creating event network-vif-deleted:572a9818-c1ee-4385-bd79-7c0a76329a99 for instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 on hv-cinder-85083 Aug 10 10:08:34.213938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-79c5cd27-10fb-4f62-a569-c32824d29f54 req-fbc04a92-0489-4746-9da3-8dc7e2cc87f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174064 Aug 10 10:08:34.215284 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 352/697] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:34.323974 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:34.352669 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c76b5a00-7238-4561-9686-0423d336e6dd tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1689 microversion: 2.1 time: 0.221206 Aug 10 10:08:34.363171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 346/698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:34 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:34.610602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:34.611611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:34.623736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:34.624235 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:34.624676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.625386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:34.626093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:34.626525 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.662642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:34.663183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:34.663625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.664079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lazy-loading 'fault' on Instance uuid bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:34.714765 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:34.725918 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:34.727676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:34.728903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9174aec9-4b31-47d1-a347-ead9ba00e38f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1371 microversion: 2.20 time: 0.122819 Aug 10 10:08:34.730219 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 353/699] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:34 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:34.781060 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d6674002-be25-453e-b80c-8ad920e5707d req-44e6c1ca-ea9d-448d-9f4b-d67b528e168b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6cb556-324b-440d-98cd-2532ad4cdc93", "name": "network-vif-plugged", "status": "completed", "tag": "0c4c8fd5-8820-40b7-802d-7b3e43f17440"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:34.794376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d6674002-be25-453e-b80c-8ad920e5707d req-44e6c1ca-ea9d-448d-9f4b-d67b528e168b service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:34.795122 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d6674002-be25-453e-b80c-8ad920e5707d req-44e6c1ca-ea9d-448d-9f4b-d67b528e168b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:34.795632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d6674002-be25-453e-b80c-8ad920e5707d req-44e6c1ca-ea9d-448d-9f4b-d67b528e168b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:34.810296 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d6674002-be25-453e-b80c-8ad920e5707d req-44e6c1ca-ea9d-448d-9f4b-d67b528e168b service nova] Creating event network-vif-plugged:0c4c8fd5-8820-40b7-802d-7b3e43f17440 for instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 on hv-cinder-85083 Aug 10 10:08:34.815907 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-d6674002-be25-453e-b80c-8ad920e5707d req-44e6c1ca-ea9d-448d-9f4b-d67b528e168b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039031 Aug 10 10:08:34.816503 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 347/700] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:08:35.147054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:35.152307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:35.153055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:35.162911 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:35.163530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:35.164085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:35.164879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:35.165417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:35.166048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:35.308535 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:35.312454 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:35.325365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1c49664b-99b3-4f69-ad78-768702a12eba tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.179157 Aug 10 10:08:35.325963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 354/701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:35 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:35.374397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:35.375123 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:35.377412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:35.382980 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:35.383491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:35.383936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:35.384632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:35.385094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:35.385526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:35.522618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:35.530139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-412fd761-2fa3-4d5a-9b42-66b22865db34 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1689 microversion: 2.1 time: 0.159984 Aug 10 10:08:35.530717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 348/702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:35 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:35.753550 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:35.754170 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:35.761786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:35.762280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:35.762727 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:35.763454 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:35.763922 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:35.764359 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:35.797535 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:35.798015 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:35.798460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:35.798908 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lazy-loading 'fault' on Instance uuid bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:35.842553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:35.852065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:35.853961 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:35.855433 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a45eef01-b25f-4f3a-be5d-361959d215e1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1371 microversion: 2.20 time: 0.106344 Aug 10 10:08:35.855996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 355/703] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:35 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:08:36.346209 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:36.346866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:36.353554 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:36.354103 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:36.354606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:36.355406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:36.355932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:36.356428 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:36.493848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:36.501536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6b597d7c-73a1-4594-9964-b5e6d186fdbf tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.159313 Aug 10 10:08:36.502139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 349/704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:36 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:36.557572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:36.558201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:36.564212 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:36.564700 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:36.565141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:36.565842 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:36.566301 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:36.566734 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:36.707276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:36.715570 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-24ef1f93-100c-4911-a26c-c8092e996e11 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1689 microversion: 2.1 time: 0.167804 Aug 10 10:08:36.716343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 356/705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:36 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:36.879469 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:36.880073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:36.885942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:36.886426 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:36.886863 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:36.887583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:36.888038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:36.888467 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:36.920815 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:36.921206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:36.921645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:36.922091 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lazy-loading 'fault' on Instance uuid bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:36.972320 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:36.980938 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:36.982446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:36.983608 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1fa71f87-4bf5-40b8-88a6-45a0dc47c1d0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 200 len: 1371 microversion: 2.20 time: 0.108446 Aug 10 10:08:36.984165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 350/706] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:36 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:37.525192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:37.526527 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:37.534260 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:37.535134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:37.536221 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:37.537150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:37.537716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:37.539266 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:37.690446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:37.698061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-19e5f997-1a3d-4b9a-9f54-86fd003ef0c5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.177335 Aug 10 10:08:37.698636 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 357/707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:37 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:37.735962 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:37.736603 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:37.743805 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:37.744495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:37.745113 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:37.746488 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:37.747130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:37.747713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:37.879418 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:37.886935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2e1f9689-a5af-4bea-9636-fdb3d3891a95 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1689 microversion: 2.1 time: 0.154801 Aug 10 10:08:37.887793 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 351/708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:37 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:38.007474 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:38.008248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:38.016504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:38.017404 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:38.018221 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:38.019543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:38.020905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:38.021695 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:38.035176 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] HTTP exception thrown: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Request method failure captured: Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 HTTP/1.1 Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84LCoL0LIvMFQCBFcB9DVAh_6HkdUyhF_Pluf8gBUZR09NN_3XIqd3dqY9jE_-vtvAU8v5FO5JHhWVeg8aNDG_QiYcSUCNFgLmFKzAf80e6-vYGYWa4nXeVTjHveaFbnqCWolXtKjRGUUJuPmzZXxWvrPbCq6HxNYiRpq3nEU-w3oJ0 Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:08:38.037507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20760466eac94b87b14c279bba223b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20760466eac94b87b14c279bba223b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}] Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2ef546ba84fa46d581ed6c82ec302e7d Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:08:38.039230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9'} Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:38.040042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:08:38.041318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:38.042415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Returning 404 to user: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:38.042415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e32228b9-fa72-4eb1-aeb6-c3b168e510a2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 404 len: 111 microversion: 2.20 time: 0.035711 Aug 10 10:08:38.042415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 358/709] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:38 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:08:38.048201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4f92cf95-9efa-4f6a-a30e-3a7d566e06bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '.version_select at 0x7f22fbd9e310>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:38.069870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4f92cf95-9efa-4f6a-a30e-3a7d566e06bc tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486393413" status: 204 len: 0 microversion: 2.20 time: 0.025659 Aug 10 10:08:38.070459 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 352/710] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Aug 10 10:08:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486393413 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 10:08:38.630665 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-cac5e063-eb68-4431-b25b-684f39019a57 req-31b05254-05b9-44e8-8b70-1e6b07536eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c63d7ad-f726-40c4-81d9-b7be9492211b", "name": "network-vif-deleted", "tag": "887e207d-4c97-4327-ac8a-a5e5d6d83824"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:38.642811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-cac5e063-eb68-4431-b25b-684f39019a57 req-31b05254-05b9-44e8-8b70-1e6b07536eac service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:38.643355 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-cac5e063-eb68-4431-b25b-684f39019a57 req-31b05254-05b9-44e8-8b70-1e6b07536eac service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:38.643788 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-cac5e063-eb68-4431-b25b-684f39019a57 req-31b05254-05b9-44e8-8b70-1e6b07536eac service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:38.664398 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-cac5e063-eb68-4431-b25b-684f39019a57 req-31b05254-05b9-44e8-8b70-1e6b07536eac service nova] Creating event network-vif-deleted:887e207d-4c97-4327-ac8a-a5e5d6d83824 for instance 3c63d7ad-f726-40c4-81d9-b7be9492211b on hv-cinder-85083 Aug 10 10:08:38.674392 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-cac5e063-eb68-4431-b25b-684f39019a57 req-31b05254-05b9-44e8-8b70-1e6b07536eac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045687 Aug 10 10:08:38.675264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 359/711] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:38.717943 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:38.718828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:38.725965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:38.726466 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:38.727122 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:38.728238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:38.728711 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:38.729150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:38.801626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9399b2b3-b2b4-485a-a934-f92208132d35 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'create', calling method: .version_select at 0x7f22fbe1f670>, body: {"keypair": {"name": "tempest-keypair-679105724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1aOEZK4COpRlStD15AjsIb0I/LcnzoTVo0CBiX3TOjItqsbPm5rV/1T9sxlhIBOxuUyZuWenVme6W53yM+dxr/Wr4pOyBuxFZiTGGzVNGRW8REtD//LNlBJG8mQkufWw=="}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:38.826801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-9399b2b3-b2b4-485a-a934-f92208132d35 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for project 20760466eac94b87b14c279bba223b2d. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:08:38.837026 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-9399b2b3-b2b4-485a-a934-f92208132d35 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for user 2ef546ba84fa46d581ed6c82ec302e7d and project 20760466eac94b87b14c279bba223b2d. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:08:38.870430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9399b2b3-b2b4-485a-a934-f92208132d35 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.077622 Aug 10 10:08:38.878643 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 360/712] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 10 10:08:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 10:08:38.910174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:38.911835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:38.925819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:38.929297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:38.930505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:38.934008 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:38.934880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:38.935425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:38.961618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:38.971965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8e7b2186-be1c-4eb5-985f-aa654b5dad8a tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1367 microversion: 2.1 time: 0.256914 Aug 10 10:08:38.987201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 353/713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:38 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:39.036174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:39.046103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-78fbd5b6-722d-486c-a8f2-158361002e1c tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 200 len: 1621 microversion: 2.1 time: 0.141484 Aug 10 10:08:39.047005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 361/714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:38 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 1621 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:39.993684 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:39.997570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:40.009664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:40.010182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:40.010623 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:40.011372 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:40.011826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:40.012251 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:40.076645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:40.080030 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 3c63d7ad-f726-40c4-81d9-b7be9492211b] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:40.086779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:40.087314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:40.087764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:40.088476 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:40.088944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:40.089370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:40.107810 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] HTTP exception thrown: Instance 3c63d7ad-f726-40c4-81d9-b7be9492211b could not be found. Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Request method failure captured: Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b HTTP/1.1 Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JhpWbH-qE-vLLswXpK03OlT8lk-cXsSH3k7Avifv_u_dOkLQ-2P0_W_annA_hwJh9vgtjslFKTGI8qvokEMcBfB7sxdLJzJo0Cxu82SqjaQdY6y0qLfKf6sqdTLNJqPJPW6QhV5jCYxANMgXAT2F2M3iVogGVjxwuBONtYn366o6w Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:08:40.109807 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}] Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: befbca3738f0481296b63c70d6d2a797 Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 3c63d7ad-f726-40c4-81d9-b7be9492211b could not be found. Aug 10 10:08:40.111200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '3c63d7ad-f726-40c4-81d9-b7be9492211b'} Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c63d7ad-f726-40c4-81d9-b7be9492211b could not be found. Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:40.111950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c63d7ad-f726-40c4-81d9-b7be9492211b could not be found. Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c63d7ad-f726-40c4-81d9-b7be9492211b could not be found. Aug 10 10:08:40.113157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:40.115614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Returning 404 to user: Instance 3c63d7ad-f726-40c4-81d9-b7be9492211b could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:40.115614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-735eff20-40d6-4a7d-a8fb-d37660d47210 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b" status: 404 len: 111 microversion: 2.1 time: 0.042939 Aug 10 10:08:40.115833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 362/715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:40 2022] GET /compute/v2.1/servers/3c63d7ad-f726-40c4-81d9-b7be9492211b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:08:40.120676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a1bdfb48-f050-418d-9711-866b1bfe67aa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '.version_select at 0x7f22fbe31670>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:40.139978 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a1bdfb48-f050-418d-9711-866b1bfe67aa tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-589177271" status: 202 len: 0 microversion: 2.1 time: 0.022883 Aug 10 10:08:40.145487 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 363/716] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 10 10:08:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-589177271 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:08:40.226813 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:40.234705 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-54b8d7b2-14fb-4480-bcdc-48866219169f tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1558 microversion: 2.1 time: 0.245151 Aug 10 10:08:40.239930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 354/717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:39 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1558 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:40.255023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:40.255497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:40.262979 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:40.263704 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:40.264369 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:40.265276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:40.265935 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:40.266376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:40.388510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5fb141a0-c219-40c4-952f-23443f299135 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137365 Aug 10 10:08:40.392511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 364/718] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:08:40 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:40.469890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-361970603", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c3db249-1a90-4663-b802-a2e70c9ff42b"}], "security_groups": [{"name": "tempest-securitygroup--1020306177"}], "key_name": "tempest-keypair-679105724", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:40.645473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] validate_networks() for [('1c3db249-1a90-4663-b802-a2e70c9ff42b', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:08:41.731537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:08:41.732124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:08:41.732433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:08:41.732846 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:08:41.733266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:08:41.744807 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:41.745450 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:41.746019 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:41.746777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:41.747287 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:41.747744 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:41.765774 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for project 20760466eac94b87b14c279bba223b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:08:41.769685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Getting quotas for user 2ef546ba84fa46d581ed6c82ec302e7d and project 20760466eac94b87b14c279bba223b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:08:41.781447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:08:41.784056 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:08:41.833189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6fa9d6f8-d2d6-428e-8f5c-a8ccbe40935e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.377026 Aug 10 10:08:41.839513 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 355/719] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 10 10:08:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 10:08:41.845431 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-90c4fbd3-e785-43a1-a73c-9b40e8b28b5e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:41.846057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-90c4fbd3-e785-43a1-a73c-9b40e8b28b5e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:41.930678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-90c4fbd3-e785-43a1-a73c-9b40e8b28b5e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:41.939440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-90c4fbd3-e785-43a1-a73c-9b40e8b28b5e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:41.941229 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-90c4fbd3-e785-43a1-a73c-9b40e8b28b5e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:41.942498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-90c4fbd3-e785-43a1-a73c-9b40e8b28b5e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1280 microversion: 2.20 time: 0.101594 Aug 10 10:08:41.943347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 365/720] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:41 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:08:42.133752 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-576e9eb5-5600-446c-a38b-d710b05a8b9a req-e94e3c5d-f68c-4ded-bd28-0556374cd158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6cb556-324b-440d-98cd-2532ad4cdc93", "tag": "0c4c8fd5-8820-40b7-802d-7b3e43f17440"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:42.146265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-576e9eb5-5600-446c-a38b-d710b05a8b9a req-e94e3c5d-f68c-4ded-bd28-0556374cd158 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:42.146822 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-576e9eb5-5600-446c-a38b-d710b05a8b9a req-e94e3c5d-f68c-4ded-bd28-0556374cd158 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:42.147290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-576e9eb5-5600-446c-a38b-d710b05a8b9a req-e94e3c5d-f68c-4ded-bd28-0556374cd158 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:42.165887 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-576e9eb5-5600-446c-a38b-d710b05a8b9a req-e94e3c5d-f68c-4ded-bd28-0556374cd158 service nova] Creating event network-changed:0c4c8fd5-8820-40b7-802d-7b3e43f17440 for instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 on hv-cinder-85083 Aug 10 10:08:42.170946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-576e9eb5-5600-446c-a38b-d710b05a8b9a req-e94e3c5d-f68c-4ded-bd28-0556374cd158 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162442 Aug 10 10:08:42.171580 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 356/721] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:42.965953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:42.966661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:42.973417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:42.974122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:42.974969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:42.975839 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:42.976452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:42.977051 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:43.083883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:43.093680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:43.096296 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:43.098040 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5c5a0352-a4ea-42d3-96ac-fe50a5baa6ed tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1340 microversion: 2.20 time: 0.136080 Aug 10 10:08:43.098750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 366/722] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:42 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1340 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:43.190159 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:43.190734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:43.197585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:43.198086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:43.198531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:43.199278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:43.199745 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:43.200182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:43.224751 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:08:43.319826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2ab8e4eb-26b2-4727-b14f-f92c9d390b08 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 204 len: 0 microversion: 2.1 time: 0.135263 Aug 10 10:08:43.321212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 357/723] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:08:43 2022] DELETE /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:08:43.329774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:43.330399 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:43.341101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:43.341599 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:43.342038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:43.342745 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:43.343231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:43.343679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:43.486796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:43.494444 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f4c5fee6-f4fb-4561-91e3-7b90d1507128 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1506 microversion: 2.1 time: 0.168692 Aug 10 10:08:43.495029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 367/724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:43 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:44.122171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:44.122816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:44.129049 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:44.129538 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:44.129979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:44.130673 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:44.131169 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:44.131607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:44.263939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:44.272478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:44.273970 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:44.275097 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-83081888-078b-4535-bea5-ae3725b79f8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.157298 Aug 10 10:08:44.275650 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 358/725] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:44 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:44.516581 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:44.517198 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:44.524328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:44.524814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:44.525254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:44.525947 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:44.526401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:44.526828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:44.652604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:44.660236 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ab599c1b-22b4-46a3-92ba-0124a5238648 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1506 microversion: 2.1 time: 0.147488 Aug 10 10:08:44.660860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 368/726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:44 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:45.297743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:45.298467 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:45.305773 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:45.306356 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:45.306803 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:45.307543 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:45.308013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:45.308449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:45.445170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:45.447592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:45.455986 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:45.458335 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:45.459648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1baabadf-5514-4209-ad2d-dcc1c97523ae tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.165884 Aug 10 10:08:45.460418 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 359/727] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:45 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:45.681095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:45.681848 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:45.688414 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:45.688985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:45.689502 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:45.690218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:45.690681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:45.691140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:45.824137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:45.831736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-42f48ca7-0097-4a50-b4cc-408bc0d03009 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1506 microversion: 2.1 time: 0.154568 Aug 10 10:08:45.832960 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 369/728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:45 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:45.866930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-d75f2898-e87b-496b-8970-95748f7dd030 req-2fd0fde4-ddfc-4f2b-a94f-1bbef6a260a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57896e7-150e-441c-a4ae-9c9f7d91227a", "tag": "5096bd70-a7a2-459b-b55a-d5cca428c770"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:45.878575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d75f2898-e87b-496b-8970-95748f7dd030 req-2fd0fde4-ddfc-4f2b-a94f-1bbef6a260a3 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:45.879665 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d75f2898-e87b-496b-8970-95748f7dd030 req-2fd0fde4-ddfc-4f2b-a94f-1bbef6a260a3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:45.880172 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-d75f2898-e87b-496b-8970-95748f7dd030 req-2fd0fde4-ddfc-4f2b-a94f-1bbef6a260a3 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:45.891385 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-d75f2898-e87b-496b-8970-95748f7dd030 req-2fd0fde4-ddfc-4f2b-a94f-1bbef6a260a3 service nova] Creating event network-changed:5096bd70-a7a2-459b-b55a-d5cca428c770 for instance b57896e7-150e-441c-a4ae-9c9f7d91227a on hv-cinder-85083 Aug 10 10:08:45.896894 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-d75f2898-e87b-496b-8970-95748f7dd030 req-2fd0fde4-ddfc-4f2b-a94f-1bbef6a260a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034764 Aug 10 10:08:45.897608 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 360/729] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:46.482224 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:46.482843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:46.488988 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:46.489519 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:46.489958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:46.490669 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:46.491149 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:46.491576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:46.634480 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:46.642596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:46.644118 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:46.645859 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bd251122-2787-48d3-b5d9-3bce55b5aaa4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.168132 Aug 10 10:08:46.646400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 370/730] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:46 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:46.853819 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:46.854548 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:46.861091 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:46.861572 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:46.862010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:46.862695 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:46.863185 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:46.864124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:46.896866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:46.897348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:46.897789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:46.898240 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lazy-loading 'fault' on Instance uuid 1e73da8d-056c-499b-8799-94fd26c5de12 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:46.938146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:46.946143 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d4328e9d-a976-4687-9416-04147454738b tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 200 len: 1311 microversion: 2.1 time: 0.096450 Aug 10 10:08:46.946713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 361/731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:46 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:47.668208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:47.668821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:47.675336 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:47.675883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:47.676324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:47.677026 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:47.677492 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:47.677923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:47.820105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:47.828109 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:47.829614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:47.830728 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-66a7f152-0fcc-46cf-9aad-25ec63e1dc8e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.166541 Aug 10 10:08:47.831316 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 371/732] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:47 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:47.922455 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-76f47c58-866e-4419-a8a4-52e2e0e60988 req-792abe24-e392-4b3b-976c-1c0f61f4fff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e73da8d-056c-499b-8799-94fd26c5de12", "name": "network-vif-deleted", "tag": "6b1b0b3d-4aff-41fe-ae46-b28d7b0a8d2e"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:47.932086 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-76f47c58-866e-4419-a8a4-52e2e0e60988 req-792abe24-e392-4b3b-976c-1c0f61f4fff9 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:47.932548 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-76f47c58-866e-4419-a8a4-52e2e0e60988 req-792abe24-e392-4b3b-976c-1c0f61f4fff9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:47.932976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-76f47c58-866e-4419-a8a4-52e2e0e60988 req-792abe24-e392-4b3b-976c-1c0f61f4fff9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:47.943983 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-76f47c58-866e-4419-a8a4-52e2e0e60988 req-792abe24-e392-4b3b-976c-1c0f61f4fff9 service nova] Creating event network-vif-deleted:6b1b0b3d-4aff-41fe-ae46-b28d7b0a8d2e for instance 1e73da8d-056c-499b-8799-94fd26c5de12 on hv-cinder-85083 Aug 10 10:08:47.948961 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-76f47c58-866e-4419-a8a4-52e2e0e60988 req-792abe24-e392-4b3b-976c-1c0f61f4fff9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030131 Aug 10 10:08:47.950168 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 362/733] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:47.966760 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:47.967443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: 1e73da8d-056c-499b-8799-94fd26c5de12] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:47.973341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:47.973833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:47.974273 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:47.975050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:47.975543 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:47.975981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:47.989878 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] HTTP exception thrown: Instance 1e73da8d-056c-499b-8799-94fd26c5de12 could not be found. Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Request method failure captured: Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 HTTP/1.1 Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JhpWbH-qE-vLLswXpK03OlT8lk-cXsSH3k7Avifv_u_dOkLQ-2P0_W_annA_hwJh9vgtjslFKTGI8qvokEMcBfB7sxdLJzJo0Cxu82SqjaQdY6y0qLfKf6sqdTLNJqPJPW6QhV5jCYxANMgXAT2F2M3iVogGVjxwuBONtYn366o6w Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:08:47.991656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}] Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: befbca3738f0481296b63c70d6d2a797 Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 1e73da8d-056c-499b-8799-94fd26c5de12 could not be found. Aug 10 10:08:47.993060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '1e73da8d-056c-499b-8799-94fd26c5de12'} Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e73da8d-056c-499b-8799-94fd26c5de12 could not be found. Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:47.993802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e73da8d-056c-499b-8799-94fd26c5de12 could not be found. Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e73da8d-056c-499b-8799-94fd26c5de12 could not be found. Aug 10 10:08:47.995027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:47.996165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Returning 404 to user: Instance 1e73da8d-056c-499b-8799-94fd26c5de12 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:47.996165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7f3c3cfa-c02a-4419-9a49-b7a61e185d26 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12" status: 404 len: 111 microversion: 2.1 time: 0.030218 Aug 10 10:08:47.996165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 372/734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:47 2022] GET /compute/v2.1/servers/1e73da8d-056c-499b-8799-94fd26c5de12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:08:48.003069 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:48.003723 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:48.011255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.012067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.013767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.014224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.014794 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.015364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.044427 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:08:48.125117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6edbb853-a117-45bb-8051-9ba5c5b64c5d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 204 len: 0 microversion: 2.1 time: 0.126311 Aug 10 10:08:48.125968 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 363/735] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:08:47 2022] DELETE /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:08:48.134032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:48.134653 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:48.140567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.141042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.141488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.142182 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.142643 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.143099 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.271209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:48.278679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-caba5aa5-3c96-4d9a-8690-b78924caab3d tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.148497 Aug 10 10:08:48.279269 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 373/736] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:48 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:48.411999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-900310822", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1577537931", "security_groups": [{"name": "tempest-secgroup-smoke-1121624455"}], "networks": [{"uuid": "dec5d0a6-dba4-48ed-8863-d70fb5dec325"}], "block_device_mapping_v2": [{"uuid": "e24c3e25-ae6e-4eaf-8818-aef1787ac4cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:48.521244 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] validate_networks() for [('dec5d0a6-dba4-48ed-8863-d70fb5dec325', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:08:48.853900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:48.855208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:48.861541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.862031 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.862474 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.863418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.863881 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.864315 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.878364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:08:48.879345 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:08:48.879920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:08:48.880341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:08:48.881067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:08:48.890041 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.890530 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.890989 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.891751 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:48.892213 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:48.892641 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:48.910129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Getting quotas for project cdaf00b54b894a9db2de21ff1ef475a2. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:08:48.914127 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Getting quotas for user 26782775a52b48e9a9a84d64d28ceca0 and project cdaf00b54b894a9db2de21ff1ef475a2. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:08:48.971728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:08:48.973948 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e24c3e25-ae6e-4eaf-8818-aef1787ac4cf',volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:08:48.999192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:49.007939 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:49.009453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:49.010562 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2bd5682d-e3e7-4ad8-8cb8-6d4f2cfbef9c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.160695 Aug 10 10:08:49.011229 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 374/737] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:48 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:08:49.101066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-928b85cc-9251-435c-97d9-18a8a862c1b1 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693898 Aug 10 10:08:49.101711 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 364/738] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:08:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:08:49.112819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cf1f99a1-0773-4b0d-959e-cc74c414a429 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:49.113987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cf1f99a1-0773-4b0d-959e-cc74c414a429 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:49.171501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cf1f99a1-0773-4b0d-959e-cc74c414a429 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:49.173854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=17 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:49.180606 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cf1f99a1-0773-4b0d-959e-cc74c414a429 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1088 microversion: 2.1 time: 0.071666 Aug 10 10:08:49.181186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 375/739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:49 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:49.299700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:49.300323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:49.306510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:49.306935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:49.307457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:49.308148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:49.308603 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:49.309205 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:49.441986 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:49.449526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b59f8ec8-984e-44d4-bac6-dc001c9968ff tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.153718 Aug 10 10:08:49.450099 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 365/740] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:49 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:50.033538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:50.034144 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:50.041221 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:50.041708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:50.042149 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:50.042840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:50.043325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:50.043757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:50.175050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:50.183685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:50.185331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:50.186447 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-38508e82-daaa-420f-8565-b118f825033a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.157387 Aug 10 10:08:50.187017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 376/741] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:50 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:50.201585 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:50.202356 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:50.209141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:50.209634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:50.210077 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:50.210778 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:50.211275 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:50.211712 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:50.273628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:50.281116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b5318a00-ec0a-4609-a703-d5454454f13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1138 microversion: 2.1 time: 0.083456 Aug 10 10:08:50.281941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 366/742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:50 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:50.470816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:50.471487 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:50.478008 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:50.478496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:50.478930 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:50.480992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:50.480992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:50.480992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:50.643698 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:50.652385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ae5aef2c-d11b-4a10-851a-29fc4ad1f289 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1520 microversion: 2.1 time: 0.185323 Aug 10 10:08:50.653059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 377/743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:50 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:51.210683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:51.211842 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:51.218301 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.219083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.219810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.220737 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.221402 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.221932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.304092 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:51.304716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:51.312580 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.320726 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.321320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.322140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.322685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.323223 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.329124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:51.429481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:51.431783 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:51.441499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:51.442930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:51.444271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9ddc3bff-8be8-4f7d-ac55-431fe8d7c7fb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.239139 Aug 10 10:08:51.444546 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-32db0018-1f43-4d34-8c96-69b7ba5d6730 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1204 microversion: 2.1 time: 0.145380 Aug 10 10:08:51.445497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 367/744] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:51 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:51.452112 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 378/745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:51 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1204 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:08:51.479746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-aa8c9591-f7b4-459f-adab-7c21f1ea8164 req-a1659dae-398a-4d20-97b8-a62c625d60b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7915e13-08f0-47b2-a0a9-334681c80ae6", "name": "network-vif-deleted", "tag": "06190a57-126a-4a49-860c-55c34d96ec18"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:51.504115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-aa8c9591-f7b4-459f-adab-7c21f1ea8164 req-a1659dae-398a-4d20-97b8-a62c625d60b1 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.504916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-aa8c9591-f7b4-459f-adab-7c21f1ea8164 req-a1659dae-398a-4d20-97b8-a62c625d60b1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.505531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-aa8c9591-f7b4-459f-adab-7c21f1ea8164 req-a1659dae-398a-4d20-97b8-a62c625d60b1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.520671 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-aa8c9591-f7b4-459f-adab-7c21f1ea8164 req-a1659dae-398a-4d20-97b8-a62c625d60b1 service nova] Creating event network-vif-deleted:06190a57-126a-4a49-860c-55c34d96ec18 for instance a7915e13-08f0-47b2-a0a9-334681c80ae6 on hv-cinder-85083 Aug 10 10:08:51.525898 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-aa8c9591-f7b4-459f-adab-7c21f1ea8164 req-a1659dae-398a-4d20-97b8-a62c625d60b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051928 Aug 10 10:08:51.526784 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 368/746] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:51.674248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:51.675263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:51.681974 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.682717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.683349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.684057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.684516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.685074 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.718176 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:51.718666 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:51.719188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:51.719830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lazy-loading 'fault' on Instance uuid a7915e13-08f0-47b2-a0a9-334681c80ae6 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:08:51.764838 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befbca3738f0481296b63c70d6d2a797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf8047a09b4fee9a12288ef323338c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:51.773095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-654aec31-46b1-4b46-8e26-90351e263163 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 200 len: 1311 microversion: 2.1 time: 0.102745 Aug 10 10:08:51.773564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 379/747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:51 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:52.467044 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:52.467841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:52.469171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:52.469821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:52.469943 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:52.476229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:52.476729 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:52.476871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:52.477199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:52.477336 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:52.477752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:52.478196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:52.478454 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:52.478827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:52.478945 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:52.479296 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:52.479425 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:52.689813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:52.695137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:52.699548 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:52.701313 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:52.702738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-29038105-870b-45af-a977-a0d76703aa95 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.237488 Aug 10 10:08:52.703500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 380/748] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:52 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:08:52.715942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e0f18f5b-2618-4ba8-812e-ad3c9aa5e778 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.253780 Aug 10 10:08:52.721593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 369/749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:52 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:52.793918 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:52.794536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] [instance: a7915e13-08f0-47b2-a0a9-334681c80ae6] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:52.804150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:52.804671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:52.805124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:52.805841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:52.806355 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:52.806806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:52.827772 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] HTTP exception thrown: Instance a7915e13-08f0-47b2-a0a9-334681c80ae6 could not be found. Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Request method failure captured: Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 HTTP/1.1 Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84JhpWbH-qE-vLLswXpK03OlT8lk-cXsSH3k7Avifv_u_dOkLQ-2P0_W_annA_hwJh9vgtjslFKTGI8qvokEMcBfB7sxdLJzJo0Cxu82SqjaQdY6y0qLfKf6sqdTLNJqPJPW6QhV5jCYxANMgXAT2F2M3iVogGVjxwuBONtYn366o6w Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:08:52.829532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbbf8047a09b4fee9a12288ef323338c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbbf8047a09b4fee9a12288ef323338c"}]}] Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: fbbf8047a09b4fee9a12288ef323338c Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177181738 Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: befbca3738f0481296b63c70d6d2a797 Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177181738-project Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance a7915e13-08f0-47b2-a0a9-334681c80ae6 could not be found. Aug 10 10:08:52.830866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'a7915e13-08f0-47b2-a0a9-334681c80ae6'} Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7915e13-08f0-47b2-a0a9-334681c80ae6 could not be found. Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:08:52.831644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7915e13-08f0-47b2-a0a9-334681c80ae6 could not be found. Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7915e13-08f0-47b2-a0a9-334681c80ae6 could not be found. Aug 10 10:08:52.832944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:08:52.834038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] Returning 404 to user: Instance a7915e13-08f0-47b2-a0a9-334681c80ae6 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:08:52.834038 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-04a64358-dbf5-45ba-8daf-4b8bc28e6274 tempest-ServerRescueNegativeTestJSON-177181738 tempest-ServerRescueNegativeTestJSON-177181738-project] 10.222.0.20 "GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6" status: 404 len: 111 microversion: 2.1 time: 0.041871 Aug 10 10:08:52.836997 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 381/750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:52 2022] GET /compute/v2.1/servers/a7915e13-08f0-47b2-a0a9-334681c80ae6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:08:52.886558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-9dbcf845-dc4b-40fe-8ee2-e9e55251e4e7 req-9f5e7e67-fb0c-4d55-b46c-1b8af0761569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57896e7-150e-441c-a4ae-9c9f7d91227a", "name": "network-vif-plugged", "status": "completed", "tag": "5096bd70-a7a2-459b-b55a-d5cca428c770"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:52.898176 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dbcf845-dc4b-40fe-8ee2-e9e55251e4e7 req-9f5e7e67-fb0c-4d55-b46c-1b8af0761569 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:52.899583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dbcf845-dc4b-40fe-8ee2-e9e55251e4e7 req-9f5e7e67-fb0c-4d55-b46c-1b8af0761569 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:52.900114 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9dbcf845-dc4b-40fe-8ee2-e9e55251e4e7 req-9f5e7e67-fb0c-4d55-b46c-1b8af0761569 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:52.912453 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-9dbcf845-dc4b-40fe-8ee2-e9e55251e4e7 req-9f5e7e67-fb0c-4d55-b46c-1b8af0761569 service nova] Creating event network-vif-plugged:5096bd70-a7a2-459b-b55a-d5cca428c770 for instance b57896e7-150e-441c-a4ae-9c9f7d91227a on hv-cinder-85083 Aug 10 10:08:52.925495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-9dbcf845-dc4b-40fe-8ee2-e9e55251e4e7 req-9f5e7e67-fb0c-4d55-b46c-1b8af0761569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115225 Aug 10 10:08:52.927066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 370/751] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:08:53.556757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-e77344eb-a500-4408-88c6-2f3dec957732 req-beee7dc6-91ee-4eb1-b182-02cd91b5ccbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb85e5e-fcd1-4e80-a2c3-10c3480645b3", "tag": "5c6eec61-2bdf-470c-b2d4-6b8196c8bee9"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:53.566510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e77344eb-a500-4408-88c6-2f3dec957732 req-beee7dc6-91ee-4eb1-b182-02cd91b5ccbc service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:53.567013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e77344eb-a500-4408-88c6-2f3dec957732 req-beee7dc6-91ee-4eb1-b182-02cd91b5ccbc service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:53.567452 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e77344eb-a500-4408-88c6-2f3dec957732 req-beee7dc6-91ee-4eb1-b182-02cd91b5ccbc service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:53.578197 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-e77344eb-a500-4408-88c6-2f3dec957732 req-beee7dc6-91ee-4eb1-b182-02cd91b5ccbc service nova] Creating event network-changed:5c6eec61-2bdf-470c-b2d4-6b8196c8bee9 for instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 on hv-cinder-85083 Aug 10 10:08:53.583824 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-e77344eb-a500-4408-88c6-2f3dec957732 req-beee7dc6-91ee-4eb1-b182-02cd91b5ccbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030651 Aug 10 10:08:53.584417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 382/752] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:08:53.728555 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:53.730207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:53.742722 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:53.743891 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:53.748839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:53.749536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:53.750884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:53.751276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:53.751629 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:53.751767 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:53.752208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:53.752328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:53.752531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:53.752888 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:53.753342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:53.753926 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:54.028068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:54.036453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-63bf7c27-1a50-4b4b-8cdd-e970e2467df7 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.298464 Aug 10 10:08:54.036809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:54.037409 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 383/753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:53 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:54.045194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:54.046706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:54.047870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-76300fef-a2e3-4d93-a2bc-02d03044cf7c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1406 microversion: 2.20 time: 0.323630 Aug 10 10:08:54.048422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 371/754] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:53 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:08:55.058027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:55.058750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:55.071806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:55.073046 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:55.083204 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:55.083987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:55.084624 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:55.085552 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:55.086011 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:55.087599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:55.088090 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:55.088764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:55.093833 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:55.094834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:55.095350 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:55.095789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:55.329084 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:55.329964 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:55.342419 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d7e5f049-66ec-41bb-890a-416b107b26d8 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.288185 Aug 10 10:08:55.345760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:55.346536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 384/755] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:55 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:55.348416 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:55.349587 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ceefa818-8bdf-4317-a2f4-5470dd0e0c0a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1597 microversion: 2.20 time: 0.282390 Aug 10 10:08:55.350120 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 372/756] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:08:55 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1597 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:08:55.372053 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:55.372557 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:55.379292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:55.379887 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:55.380332 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:55.381042 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:55.381512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:55.381947 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:55.461662 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0edcdae0-9c18-4ce8-9717-8ff1adcb5a59 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093442 Aug 10 10:08:55.462261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 385/757] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 10 10:08:55 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:08:56.383050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:56.388867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:56.398326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:56.399175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:56.399843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:56.400789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:56.401472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:56.402118 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:56.610669 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-2ce64817-020d-49a5-8d40-c01bc90c6b29 req-3267e267-dd19-4540-834a-32fad3b6d89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57896e7-150e-441c-a4ae-9c9f7d91227a", "tag": "5096bd70-a7a2-459b-b55a-d5cca428c770"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:08:56.625320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:56.627651 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-2ce64817-020d-49a5-8d40-c01bc90c6b29 req-3267e267-dd19-4540-834a-32fad3b6d89b service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:56.628392 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-2ce64817-020d-49a5-8d40-c01bc90c6b29 req-3267e267-dd19-4540-834a-32fad3b6d89b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:56.629550 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-2ce64817-020d-49a5-8d40-c01bc90c6b29 req-3267e267-dd19-4540-834a-32fad3b6d89b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:56.631301 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:56.641794 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-2ce64817-020d-49a5-8d40-c01bc90c6b29 req-3267e267-dd19-4540-834a-32fad3b6d89b service nova] Creating event network-changed:5096bd70-a7a2-459b-b55a-d5cca428c770 for instance b57896e7-150e-441c-a4ae-9c9f7d91227a on hv-cinder-85083 Aug 10 10:08:56.649043 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-18b9ed56-9bbd-4868-9a67-795e5b4e4057 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.277093 Aug 10 10:08:56.649827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 373/758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:56 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:56.651338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-2ce64817-020d-49a5-8d40-c01bc90c6b29 req-3267e267-dd19-4540-834a-32fad3b6d89b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047442 Aug 10 10:08:56.655725 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 386/759] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:08:57.669560 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:57.670236 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:57.677662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:57.678198 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:57.678651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:57.679373 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:57.679836 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:57.680274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:57.834175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:57.842537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e7ea37a6-3d4a-4fe4-a826-519a93e66d7a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.176651 Aug 10 10:08:57.846986 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 374/760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:57 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:08:58.866840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:08:58.867687 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:08:58.875183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:58.876459 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:58.876969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:58.877894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:08:58.878844 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:08:58.879400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:08:59.134808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:08:59.142652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e53ce460-4faf-41b8-b91e-6cd19719233b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.282063 Aug 10 10:08:59.143331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 387/761] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:08:58 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:00.163696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:00.164308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:00.167199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:00.168007 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=12 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:00.174051 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:00.174567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:00.175243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:00.176734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:00.177319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:00.177760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:00.403174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:00.415397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b224b898-7ba2-45db-a744-863afc7a09c2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.256039 Aug 10 10:09:00.418583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 375/762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:00 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:01.437776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:01.438417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:01.444780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:01.446885 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:01.447441 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:01.447894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:01.448621 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:01.449087 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:01.449519 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:01.724200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:01.733347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5b4a3677-8e44-436e-8c1a-719f6d98c8f2 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.299401 Aug 10 10:09:01.734160 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 388/763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:01 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:02.460964 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-267db13d-fd9e-456c-ab24-006cf17317da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'create', calling method: .version_select at 0x7f22fbce3550>, body: {"keypair": {"name": "tempest-keypair-1965846176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA660kyle89eJo/jzFQa5AZBtthRQfQuOf/bWUH7Cg6ZlJETOTuZnRFztpR6wswoCn3uvkM5ygtGnGs1NFpB9DcQ41UipqOnYMXaNgQHYGAvp71mOKDuzdojYREGiTXy6g=="}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:02.477496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-267db13d-fd9e-456c-ab24-006cf17317da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:09:02.481577 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-267db13d-fd9e-456c-ab24-006cf17317da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for user 67a34ddb337649ee948d319b0bf5fab3 and project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'key_pairs'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:09:02.504387 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-267db13d-fd9e-456c-ab24-006cf17317da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174414 Aug 10 10:09:02.505003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 376/764] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:09:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:02.754567 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:02.755248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:02.763820 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:02.764835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:02.771600 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:02.772777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:02.773428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:02.774147 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:02.862750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-b9510ded-84ef-4c18-8635-8f91be4124ca req-fba4a3ce-5d8e-4444-b8fa-607bfc9c8d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb85e5e-fcd1-4e80-a2c3-10c3480645b3", "name": "network-vif-plugged", "status": "completed", "tag": "5c6eec61-2bdf-470c-b2d4-6b8196c8bee9"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:02.875095 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b9510ded-84ef-4c18-8635-8f91be4124ca req-fba4a3ce-5d8e-4444-b8fa-607bfc9c8d0f service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:02.875567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b9510ded-84ef-4c18-8635-8f91be4124ca req-fba4a3ce-5d8e-4444-b8fa-607bfc9c8d0f service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:02.876329 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-b9510ded-84ef-4c18-8635-8f91be4124ca req-fba4a3ce-5d8e-4444-b8fa-607bfc9c8d0f service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:02.912693 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-b9510ded-84ef-4c18-8635-8f91be4124ca req-fba4a3ce-5d8e-4444-b8fa-607bfc9c8d0f service nova] Creating event network-vif-plugged:5c6eec61-2bdf-470c-b2d4-6b8196c8bee9 for instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 on hv-cinder-85083 Aug 10 10:09:02.924561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-b9510ded-84ef-4c18-8635-8f91be4124ca req-fba4a3ce-5d8e-4444-b8fa-607bfc9c8d0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062450 Aug 10 10:09:02.926978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 377/765] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:02.991084 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:02.999923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b97564cc-1527-401a-a239-302103ff34d0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.249971 Aug 10 10:09:03.001179 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 389/766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:02 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:03.726819 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:03.727461 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:03.734346 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:03.734837 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:03.735296 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:03.735993 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:03.736448 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:03.736882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:03.765270 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:09:03.789869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:03.844237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2985f2f9-8fb7-420b-81aa-7e3589e0be0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 204 len: 0 microversion: 2.1 time: 0.122820 Aug 10 10:09:03.845289 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 378/767] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:09:03 2022] DELETE /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:09:03.853821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:03.854437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:03.861341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:03.861827 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:03.862267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:03.863647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:03.864197 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:03.864624 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:04.020250 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1261267631", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d5abfff-bcea-4881-a2ae-753e70ad39a2"}], "security_groups": [{"name": "tempest-securitygroup--501487673"}], "key_name": "tempest-keypair-1965846176", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:04.027242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:04.036124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-db6aa17a-f322-42a4-931f-1754be47a48f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1577 microversion: 2.1 time: 0.186089 Aug 10 10:09:04.036709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 390/768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:03 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:04.047852 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:04.048481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:04.054497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:04.055019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:04.055469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:04.056197 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:04.056671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:04.057873 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:04.168661 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] validate_networks() for [('5d5abfff-bcea-4881-a2ae-753e70ad39a2', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:09:04.277351 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:04.285413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-93a8b686-370c-412a-abd8-5e736e9baa40 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1260 microversion: 2.1 time: 0.247178 Aug 10 10:09:04.286211 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 391/769] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:04 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:04.607898 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:09:04.608293 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:09:04.609196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:09:04.609624 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:09:04.610305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:09:04.622542 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:04.623065 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:04.623516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:04.624778 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:04.625281 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:04.625985 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:04.643434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:09:04.647691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for user 67a34ddb337649ee948d319b0bf5fab3 and project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:09:04.658928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:09:04.661884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:09:04.708396 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-afedaf22-815d-49f2-ac61-291413871fe3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.692988 Aug 10 10:09:04.709375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 379/770] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:09:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 10:09:04.720020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d20cc1ea-524e-4811-ac9e-66856cd2d9b0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:04.720642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d20cc1ea-524e-4811-ac9e-66856cd2d9b0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:04.780775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d20cc1ea-524e-4811-ac9e-66856cd2d9b0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:04.788918 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d20cc1ea-524e-4811-ac9e-66856cd2d9b0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1238 microversion: 2.1 time: 0.072857 Aug 10 10:09:04.790455 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 392/771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:04 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:05.058304 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:05.059697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:05.065837 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.067330 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.067782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:05.068679 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.069180 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.069621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:05.204322 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:05.212300 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dab3231e-033d-4021-a247-5eb96b052a26 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1577 microversion: 2.1 time: 0.158490 Aug 10 10:09:05.212884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 380/772] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:05 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:05.307678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:05.308196 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:05.315592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.316821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.317263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:05.317967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.318427 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.318860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:05.455613 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:05.464296 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e74e0cf0-8e64-4f8f-841a-42800c0b08aa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1444 microversion: 2.1 time: 0.160574 Aug 10 10:09:05.464894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 393/773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:05 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:05.485156 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:05.485895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:05.492278 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.492864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.493307 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:05.494016 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.494471 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.494898 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:05.626721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:05.634436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7264a504-762a-41fd-81e5-83b70f749981 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1444 microversion: 2.1 time: 0.153170 Aug 10 10:09:05.635030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 381/774] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:05 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:05.809828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:05.810551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:05.817176 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.817671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.818112 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:05.818886 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:05.819298 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:05.819709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:06.192127 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:06.203098 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dd09e340-726d-4dfb-840c-c8a601a8c92f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1234 microversion: 2.1 time: 0.396352 Aug 10 10:09:06.204077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 394/775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:05 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1234 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:06.236936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:06.239420 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:06.249283 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:06.250162 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:06.251658 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:06.254090 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:06.254989 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:06.256801 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:06.594224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:06.606420 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-18a3a0fc-74a3-48c1-9726-f07cebfffe6a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1577 microversion: 2.1 time: 0.374440 Aug 10 10:09:06.607037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 382/776] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:06 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1577 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:07.230724 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:07.232092 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:07.243895 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:07.244490 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:07.245028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:07.246085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:07.246756 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:07.247433 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:07.391987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:07.405127 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4ca24cb1-a1a0-4005-a667-0ac830778082 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1296 microversion: 2.1 time: 0.184033 Aug 10 10:09:07.408492 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 395/777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:07 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1296 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:07.516601 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-0f783591-a3bd-43c2-b1d7-8cc9ad271a0e req-563ae373-94c0-4cbb-8912-e81a0f71f331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479fd26a-e2a8-4d55-a760-afbc7de61715", "name": "network-vif-deleted", "tag": "94e22129-7a42-4420-8f52-51b45bb6fffc"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:07.547177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-0f783591-a3bd-43c2-b1d7-8cc9ad271a0e req-563ae373-94c0-4cbb-8912-e81a0f71f331 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:07.548696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-0f783591-a3bd-43c2-b1d7-8cc9ad271a0e req-563ae373-94c0-4cbb-8912-e81a0f71f331 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:07.549391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-0f783591-a3bd-43c2-b1d7-8cc9ad271a0e req-563ae373-94c0-4cbb-8912-e81a0f71f331 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:07.563178 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-0f783591-a3bd-43c2-b1d7-8cc9ad271a0e req-563ae373-94c0-4cbb-8912-e81a0f71f331 service nova] Creating event network-vif-deleted:94e22129-7a42-4420-8f52-51b45bb6fffc for instance 479fd26a-e2a8-4d55-a760-afbc7de61715 on hv-cinder-85083 Aug 10 10:09:07.569890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-0f783591-a3bd-43c2-b1d7-8cc9ad271a0e req-563ae373-94c0-4cbb-8912-e81a0f71f331 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059179 Aug 10 10:09:07.572321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 383/778] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:07.632440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:07.633270 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:07.641603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:07.643113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:07.643849 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:07.645216 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:07.645934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:07.646590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:07.731265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:07.744980 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1c5d95eb-ef9f-419d-ba1f-bfb6165b76dc tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 200 len: 1225 microversion: 2.1 time: 0.119323 Aug 10 10:09:07.746570 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 396/779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:07 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:08.198545 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-4b092824-5eb9-400c-b0fa-4d0eecba99b5 req-03805c0a-681b-4759-861f-6e4dfd635897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb85e5e-fcd1-4e80-a2c3-10c3480645b3", "tag": "5c6eec61-2bdf-470c-b2d4-6b8196c8bee9"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:08.223321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-4b092824-5eb9-400c-b0fa-4d0eecba99b5 req-03805c0a-681b-4759-861f-6e4dfd635897 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:08.224088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-4b092824-5eb9-400c-b0fa-4d0eecba99b5 req-03805c0a-681b-4759-861f-6e4dfd635897 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:08.224802 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-4b092824-5eb9-400c-b0fa-4d0eecba99b5 req-03805c0a-681b-4759-861f-6e4dfd635897 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:08.282499 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-4b092824-5eb9-400c-b0fa-4d0eecba99b5 req-03805c0a-681b-4759-861f-6e4dfd635897 service nova] Creating event network-changed:5c6eec61-2bdf-470c-b2d4-6b8196c8bee9 for instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 on hv-cinder-85083 Aug 10 10:09:08.291335 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-4b092824-5eb9-400c-b0fa-4d0eecba99b5 req-03805c0a-681b-4759-861f-6e4dfd635897 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097053 Aug 10 10:09:08.293033 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 384/780] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:08.437681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:08.438320 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:08.455164 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:08.455672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:08.456118 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:08.467889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:08.468400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:08.468861 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:08.721226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:08.725775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:08.731309 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-547a2891-a80d-4675-9656-ab9742d502f8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1363 microversion: 2.1 time: 0.302843 Aug 10 10:09:08.733642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 397/781] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:08 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:08.776688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:08.778050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:08.793654 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:08.794981 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:08.799279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:08.800814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:08.802684 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:08.803280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:08.827227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] HTTP exception thrown: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Request method failure captured: Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 HTTP/1.1 Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84MHGXWcO6js7q284IDmaN9I2THAWFpaQ0BFBqiZLoVPIzggtRSi2qXmMKgmSWFTVbRHrorw6-XFB1kLcwFVDnZ76RIhDO5e91X8A3egWudQiARnJfZh8oAT_5IbqI7UiKyyKZyvT__wrphq_wUYvR74Wkxc-sQRNjvnFxs52QF-N3I Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:08.830140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}] Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestVolumeBootPattern-705303146 Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 7a9c654fc9bc4ad4b530d3f4df5c24c8 Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:09:08.833617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '479fd26a-e2a8-4d55-a760-afbc7de61715'} Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:08.834760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:09:08.836083 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:08.838686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Returning 404 to user: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:08.838686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-26d7b2b5-9d19-4bc1-b7bf-9009e4e54b50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 404 len: 111 microversion: 2.1 time: 0.063703 Aug 10 10:09:08.838686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 385/782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:08 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:08.940269 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-127685650", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-329800085", "security_groups": [{"name": "tempest-secgroup-smoke-232252562"}], "block_device_mapping_v2": [{"uuid": "8d961944-1b96-47de-8106-c606c36dd553", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65312932-d264-4229-974f-272fdfb7e5f8"}]}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:09.086691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.network.neutron [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] validate_networks() for [('65312932-d264-4229-974f-272fdfb7e5f8', None, None, None, None, None)] {{(pid=117895) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:09:09.533948 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Flavor limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:09:09.534549 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Image limits 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:09:09.534883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Flavor pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:09:09.535328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Image pref 0:0:0 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:09:09.535749 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.virt.hardware [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117895) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:09:09.544527 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:09.545018 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:09.545460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:09.546281 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:09.546692 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:09.547149 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:09.564678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:09:09.569166 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for user 7a9c654fc9bc4ad4b530d3f4df5c24c8 and project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'cores', 'ram', 'instances'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:09:09.605157 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-68f6da5d-2e41-499d-9a27-e01d64421e86 req-b70f82c0-53e9-496f-ae0f-94c1a4c6ebd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984ac747-1c6d-40bf-8a41-b7873c68b603", "tag": "e5df3a48-fb99-4636-80fa-43c28a7e64cb"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:09.615356 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-68f6da5d-2e41-499d-9a27-e01d64421e86 req-b70f82c0-53e9-496f-ae0f-94c1a4c6ebd5 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:09.615837 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-68f6da5d-2e41-499d-9a27-e01d64421e86 req-b70f82c0-53e9-496f-ae0f-94c1a4c6ebd5 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:09.616277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-68f6da5d-2e41-499d-9a27-e01d64421e86 req-b70f82c0-53e9-496f-ae0f-94c1a4c6ebd5 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:09.628990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-68f6da5d-2e41-499d-9a27-e01d64421e86 req-b70f82c0-53e9-496f-ae0f-94c1a4c6ebd5 service nova] Creating event network-changed:e5df3a48-fb99-4636-80fa-43c28a7e64cb for instance 984ac747-1c6d-40bf-8a41-b7873c68b603 on hv-cinder-85083 Aug 10 10:09:09.634015 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-68f6da5d-2e41-499d-9a27-e01d64421e86 req-b70f82c0-53e9-496f-ae0f-94c1a4c6ebd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032416 Aug 10 10:09:09.634986 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 386/783] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:09.636679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Going to run 1 instances... {{(pid=117895) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:09:09.638784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d961944-1b96-47de-8106-c606c36dd553',volume_size=None,volume_type=None)] {{(pid=117895) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:09:09.754603 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:09.755331 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:09.761620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:09.762286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:09.762901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:09.764008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:09.764587 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:09.765341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:09.767915 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3af48165-b450-45fe-9b07-26c91d923cf4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.831484 Aug 10 10:09:09.768572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 398/784] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:09:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:09:09.779245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bbd04767-45fd-475d-b6bf-d2691e26bfee tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:09.779858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-bbd04767-45fd-475d-b6bf-d2691e26bfee tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:09.842436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-bbd04767-45fd-475d-b6bf-d2691e26bfee tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:09.849817 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bbd04767-45fd-475d-b6bf-d2691e26bfee tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1093 microversion: 2.1 time: 0.074392 Aug 10 10:09:09.850615 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 399/785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:09 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:09.932415 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:09.939977 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8772946d-a05f-49e2-a0b7-1c39dbbb7fee tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1363 microversion: 2.1 time: 0.190000 Aug 10 10:09:09.940631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 387/786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:09 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:10.871248 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:10.871868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:10.879020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:10.879520 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:10.879965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:10.880661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:10.881123 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:10.881555 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:10.943871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:10.951511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b37c4a3e-3537-4cd8-84cc-73fb8d281db4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1191 microversion: 2.1 time: 0.084332 Aug 10 10:09:10.952103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 400/787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:10 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:10.961591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:10.962243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:10.968936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:10.969429 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:10.969904 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:10.970602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:10.971107 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:10.971545 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:11.099609 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:11.107039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-546cbfd2-43d9-41d2-8050-03fa51e87c5c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1363 microversion: 2.1 time: 0.149466 Aug 10 10:09:11.107609 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 388/788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:10 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:11.973740 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:11.974461 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:11.981780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:11.982346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:11.982877 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:11.983725 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:11.984191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:11.984623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:12.129567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:12.130196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:12.134833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:12.136716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:12.137220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:12.137676 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:12.138370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:12.139148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:12.139757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:12.142829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-be926d39-01f6-44c1-b4fb-388b217ac0f4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.173547 Aug 10 10:09:12.143627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 401/789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:11 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:12.278470 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:12.286667 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-124e17c9-06a0-4e2a-9f73-06d4e754da1a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1363 microversion: 2.1 time: 0.162476 Aug 10 10:09:12.299841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 389/790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:12 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:12.676264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-aebc8960-ba1c-495b-8947-fdbbd10d7644 req-bacc0fe0-0483-4221-9435-4af5b3a4c250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7f1046-d973-491b-823c-2f174d6a3c23", "tag": "81662ae7-c0b0-499e-851f-61aeef6c8739"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:12.687225 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-aebc8960-ba1c-495b-8947-fdbbd10d7644 req-bacc0fe0-0483-4221-9435-4af5b3a4c250 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:12.688312 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-aebc8960-ba1c-495b-8947-fdbbd10d7644 req-bacc0fe0-0483-4221-9435-4af5b3a4c250 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:12.688931 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-aebc8960-ba1c-495b-8947-fdbbd10d7644 req-bacc0fe0-0483-4221-9435-4af5b3a4c250 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:12.701813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-aebc8960-ba1c-495b-8947-fdbbd10d7644 req-bacc0fe0-0483-4221-9435-4af5b3a4c250 service nova] Creating event network-changed:81662ae7-c0b0-499e-851f-61aeef6c8739 for instance db7f1046-d973-491b-823c-2f174d6a3c23 on hv-cinder-85083 Aug 10 10:09:12.708349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-aebc8960-ba1c-495b-8947-fdbbd10d7644 req-bacc0fe0-0483-4221-9435-4af5b3a4c250 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035589 Aug 10 10:09:12.709161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 402/791] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:13.165280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:13.165897 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:13.172345 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:13.172839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:13.173277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:13.173969 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:13.174428 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:13.174859 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:13.309475 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:13.310194 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:13.313803 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:13.319391 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:13.319898 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:13.320713 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:13.321597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:13.322062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:13.322498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:13.324409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5aa17666-0600-4510-8535-c24f801ec4f7 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.163074 Aug 10 10:09:13.324973 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 390/792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:13 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:13.456915 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:13.464253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f44cc5d4-d286-4884-a7c2-a6b4d52f0b5d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1363 microversion: 2.1 time: 0.160803 Aug 10 10:09:13.464985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 403/793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:13 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:14.345371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:14.345978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:14.352873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:14.353353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:14.353795 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:14.354498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:14.354934 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:14.355525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:14.484170 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:14.484880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:14.485499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:14.491699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cc4405a6-7e77-4246-98b0-71774314c68e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.150163 Aug 10 10:09:14.491872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:14.492266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 391/794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:14 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:14.492380 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:14.492784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:14.493479 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:14.493932 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:14.494358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:14.624101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:14.632497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-976dddc5-e984-4d12-8969-8df4599e3df6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1363 microversion: 2.1 time: 0.151435 Aug 10 10:09:14.633154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 404/795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:14 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:14.898897 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-2aa911d0-c7a8-4504-bfcf-31a56fabbba6 req-0ac6807e-ebb1-4cc6-813b-9e49a96bf1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984ac747-1c6d-40bf-8a41-b7873c68b603", "name": "network-vif-plugged", "status": "completed", "tag": "e5df3a48-fb99-4636-80fa-43c28a7e64cb"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:14.903844 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:14.904520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=10 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:14.911441 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-2aa911d0-c7a8-4504-bfcf-31a56fabbba6 req-0ac6807e-ebb1-4cc6-813b-9e49a96bf1d9 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:14.911927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-2aa911d0-c7a8-4504-bfcf-31a56fabbba6 req-0ac6807e-ebb1-4cc6-813b-9e49a96bf1d9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:14.912363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-2aa911d0-c7a8-4504-bfcf-31a56fabbba6 req-0ac6807e-ebb1-4cc6-813b-9e49a96bf1d9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:14.923652 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-2aa911d0-c7a8-4504-bfcf-31a56fabbba6 req-0ac6807e-ebb1-4cc6-813b-9e49a96bf1d9 service nova] Creating event network-vif-plugged:e5df3a48-fb99-4636-80fa-43c28a7e64cb for instance 984ac747-1c6d-40bf-8a41-b7873c68b603 on hv-cinder-85083 Aug 10 10:09:14.929072 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-2aa911d0-c7a8-4504-bfcf-31a56fabbba6 req-0ac6807e-ebb1-4cc6-813b-9e49a96bf1d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033958 Aug 10 10:09:14.929860 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 392/796] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:15.512695 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:15.513316 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:15.520275 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:15.520769 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:15.521213 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:15.521918 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:15.522383 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:15.522819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:15.648553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:15.654612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:15.655347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:15.655952 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-79ab3d23-afa7-4a63-b5e5-a9ad6f7c9771 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.147142 Aug 10 10:09:15.656548 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 405/797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:15 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:15.662353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:15.662790 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:15.663261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:15.663961 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:15.664416 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:15.664855 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:15.794044 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:15.801397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d38825e0-71bc-4ec7-a30f-85baadddac70 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1363 microversion: 2.1 time: 0.151501 Aug 10 10:09:15.801969 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 393/798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:15 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:16.677857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:16.678473 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:16.684949 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:16.685440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:16.685879 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:16.686574 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:16.687063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:16.687498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:16.814113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:16.821598 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a8a0042e-df75-4659-89d9-a1bfe09fe579 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.148169 Aug 10 10:09:16.822135 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:16.822709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 406/799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:16 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:16.822875 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:16.829260 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:16.829747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:16.830195 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:16.830889 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:16.831926 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:16.832362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:16.961354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:16.968644 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-48bfc662-199d-4caf-83ec-999656124aca tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1549 microversion: 2.1 time: 0.150453 Aug 10 10:09:16.969236 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 394/800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:16 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:16.989280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:16.989782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:16.995718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:16.996202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:16.996639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:16.997348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:16.997801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:16.998223 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:17.078012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d319055e-eb8d-4e45-ba1c-2144028adbfe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092505 Aug 10 10:09:17.078851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 407/801] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:09:16 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:17.841885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:17.842508 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:17.848999 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:17.849489 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:17.849927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:17.850621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:17.851111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:17.851564 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:18.050922 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-76ff81f4-bca1-4dd5-ab92-2007a1625237 req-ade4234e-f325-4690-844b-796932872113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "984ac747-1c6d-40bf-8a41-b7873c68b603", "tag": "e5df3a48-fb99-4636-80fa-43c28a7e64cb"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:18.054561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:18.068876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-76ff81f4-bca1-4dd5-ab92-2007a1625237 req-ade4234e-f325-4690-844b-796932872113 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:18.069514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-76ff81f4-bca1-4dd5-ab92-2007a1625237 req-ade4234e-f325-4690-844b-796932872113 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:18.070052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-76ff81f4-bca1-4dd5-ab92-2007a1625237 req-ade4234e-f325-4690-844b-796932872113 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:18.070644 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9d647add-1221-4331-a909-3622d2e2da50 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.232544 Aug 10 10:09:18.075817 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 395/802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:17 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:18.091206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-76ff81f4-bca1-4dd5-ab92-2007a1625237 req-ade4234e-f325-4690-844b-796932872113 service nova] Creating event network-changed:e5df3a48-fb99-4636-80fa-43c28a7e64cb for instance 984ac747-1c6d-40bf-8a41-b7873c68b603 on hv-cinder-85083 Aug 10 10:09:18.097469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-76ff81f4-bca1-4dd5-ab92-2007a1625237 req-ade4234e-f325-4690-844b-796932872113 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050931 Aug 10 10:09:18.098470 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 408/803] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:18.414739 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:18.415281 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:18.421231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:18.421728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:18.422175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:18.422883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:18.423379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:18.423841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:18.446888 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2d37899d-07f3-4bce-8f88-abdcfdd19b99 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/ips" status: 200 len: 150 microversion: 2.1 time: 0.035980 Aug 10 10:09:18.447575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 396/804] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:09:18 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:19.096304 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:19.097005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:19.103560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:19.104053 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:19.104495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:19.105195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:19.105657 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:19.106086 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:19.248065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:19.256854 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-94e13e81-c9f0-4299-bb3b-b15603b9498b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.164860 Aug 10 10:09:19.257621 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 409/805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:19 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:19.794895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a283c29-99e8-4482-b64d-c4191bea4437"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:19.797264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:19.804372 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:19.804856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:19.805295 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:19.805984 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:19.806443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:19.806875 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:20.036584 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:20.058618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-12b22f65-7e8b-4550-bd4d-e20c3bbeaf13 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "POST /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267395 Aug 10 10:09:20.059464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 397/806] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:09:19 2022] POST /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:20.278492 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:20.279192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:20.281035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:20.281770 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=10 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:20.287967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:20.288616 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:20.289068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:20.289563 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:20.290018 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:20.290443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:20.667760 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:20.675639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2259a316-6da3-4ceb-9b10-2e8de08d1fb6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.400567 Aug 10 10:09:20.676202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 410/807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:20 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:21.696606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:21.697220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:21.703835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:21.704317 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:21.704750 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:21.705438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:21.705900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:21.706826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:21.836230 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:21.844397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-337c8a56-200f-4330-a074-f99bd53f06af tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.152016 Aug 10 10:09:21.844975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 398/808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:21 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:22.865888 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:22.866504 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:22.874808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:22.875361 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:22.876334 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:22.877490 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:22.878681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:22.879156 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:22.939647 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-512e59ad-6600-4554-87ce-29440e6720ca req-3c4c6582-306f-473e-9e7d-7f4254b02383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7f1046-d973-491b-823c-2f174d6a3c23", "name": "network-vif-plugged", "status": "completed", "tag": "81662ae7-c0b0-499e-851f-61aeef6c8739"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:22.947940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:22.953826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-512e59ad-6600-4554-87ce-29440e6720ca req-3c4c6582-306f-473e-9e7d-7f4254b02383 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:22.954398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-512e59ad-6600-4554-87ce-29440e6720ca req-3c4c6582-306f-473e-9e7d-7f4254b02383 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:22.954916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-512e59ad-6600-4554-87ce-29440e6720ca req-3c4c6582-306f-473e-9e7d-7f4254b02383 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:23.039722 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:23.048158 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9040c1e9-5ba5-451b-83da-db8fd616610d tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.186155 Aug 10 10:09:23.048762 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 411/809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:22 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:23.123592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-512e59ad-6600-4554-87ce-29440e6720ca req-3c4c6582-306f-473e-9e7d-7f4254b02383 service nova] Creating event network-vif-plugged:81662ae7-c0b0-499e-851f-61aeef6c8739 for instance db7f1046-d973-491b-823c-2f174d6a3c23 on hv-cinder-85083 Aug 10 10:09:23.129710 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-512e59ad-6600-4554-87ce-29440e6720ca req-3c4c6582-306f-473e-9e7d-7f4254b02383 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193626 Aug 10 10:09:23.130321 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 399/810] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:24.069343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:24.069963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:24.076416 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:24.076909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:24.077353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:24.078052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:24.078525 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:24.078974 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:24.209917 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:24.217329 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-972f5aac-5747-4388-a6d5-15a848e3c4c6 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1264 microversion: 2.1 time: 0.151935 Aug 10 10:09:24.217893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 412/811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:24 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:25.239244 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:25.239941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:25.247662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:25.248139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:25.248588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:25.249277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:25.249732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:25.250162 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:25.384654 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:25.392096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-08b6d4f2-5a86-421f-8074-69a0e26b1489 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1451 microversion: 2.1 time: 0.157351 Aug 10 10:09:25.392654 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 400/812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:25 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:25.412998 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:25.413617 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:25.419579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:25.420068 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:25.420507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:25.421207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:25.421670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:25.422103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:25.548957 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:25.556816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-af1c01d5-7707-4d61-be04-dd6eff26044f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1451 microversion: 2.1 time: 0.147818 Aug 10 10:09:25.557379 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 413/813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:25 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:27.131657 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-79ec6a15-a1ee-4751-a716-cbae5f229408 req-cbe419b3-2dbe-4d81-b972-c9d431758ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7f1046-d973-491b-823c-2f174d6a3c23", "tag": "81662ae7-c0b0-499e-851f-61aeef6c8739"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:27.141155 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-79ec6a15-a1ee-4751-a716-cbae5f229408 req-cbe419b3-2dbe-4d81-b972-c9d431758ce9 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:27.141634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-79ec6a15-a1ee-4751-a716-cbae5f229408 req-cbe419b3-2dbe-4d81-b972-c9d431758ce9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:27.142075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-79ec6a15-a1ee-4751-a716-cbae5f229408 req-cbe419b3-2dbe-4d81-b972-c9d431758ce9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:27.154050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-79ec6a15-a1ee-4751-a716-cbae5f229408 req-cbe419b3-2dbe-4d81-b972-c9d431758ce9 service nova] Creating event network-changed:81662ae7-c0b0-499e-851f-61aeef6c8739 for instance db7f1046-d973-491b-823c-2f174d6a3c23 on hv-cinder-85083 Aug 10 10:09:27.160089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-79ec6a15-a1ee-4751-a716-cbae5f229408 req-cbe419b3-2dbe-4d81-b972-c9d431758ce9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031198 Aug 10 10:09:27.160673 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 401/814] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:27.746454 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:27.747639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:27.754331 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:27.754835 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:27.755318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:27.756043 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:27.756510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:27.756944 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:27.846027 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lazy-loading 'services' on Instance uuid 5f6cb556-324b-440d-98cd-2532ad4cdc93 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:09:27.923491 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bb5c8961-d877-40c5-947a-eeaf51c0a095 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments/9a283c29-99e8-4482-b64d-c4191bea4437" status: 202 len: 0 microversion: 2.1 time: 0.180232 Aug 10 10:09:27.924089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 414/815] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:09:27 2022] DELETE /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments/9a283c29-99e8-4482-b64d-c4191bea4437 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:09:27.933290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:27.935810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:27.944634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:27.945130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:27.945850 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:27.946591 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:27.947139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:27.947569 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:27.983254 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cbadb53f-3714-4c8c-9af6-823a394497c6 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054189 Aug 10 10:09:27.983878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 402/816] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:09:27 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:28.996629 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:28.998870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:29.001071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:29.007394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:29.007882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:29.008321 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:29.009012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:29.009473 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:29.009896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:29.038544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bb318418-4d46-4a78-b83b-3a8f3a7064bc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046779 Aug 10 10:09:29.039118 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 415/817] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:09:28 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:09:29.098153 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:29.098660 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:29.104977 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:29.105457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:29.105892 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:29.106575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:29.107091 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:29.107536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:29.132116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:09:29.205050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5abcace6-c6c9-4b53-970f-dfe258b57c42 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 204 len: 0 microversion: 2.1 time: 0.110368 Aug 10 10:09:29.209034 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 403/818] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:09:29 2022] DELETE /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:09:29.214449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:29.215116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:29.221607 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:29.222279 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:29.222724 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:29.223489 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:29.223950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:29.224382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:29.355373 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:29.363279 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-229b1db6-8c7a-4091-9545-d2b503d74072 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1682 microversion: 2.1 time: 0.153123 Aug 10 10:09:29.363845 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 416/819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:29 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:09:30.386821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:30.387756 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:30.394772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:30.395291 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:30.395743 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:30.396439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:30.396900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:30.397328 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:30.533733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:30.541605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-42ba4efe-022d-4171-a578-d64b64034f3c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1682 microversion: 2.1 time: 0.158996 Aug 10 10:09:30.542228 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 404/820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:30 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:31.561965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:31.562634 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:31.569785 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:31.570277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:31.570711 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:31.571488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:31.572057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:31.572490 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:31.576385 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:31.637245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd3653b931643318f1a1b0820620277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66439eb22e4a4938b0522bfd356ca3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:31.645465 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-80608920-3e60-47ef-b614-2a2d54b5fbf3 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 200 len: 1615 microversion: 2.1 time: 0.087350 Aug 10 10:09:31.646041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 417/821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:31 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:09:31.905310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-6a65d769-3770-465c-8b6f-6870236f9f97 req-8a8dd144-13d6-4e35-bbe8-c05e878ad216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6cb556-324b-440d-98cd-2532ad4cdc93", "name": "network-vif-deleted", "tag": "0c4c8fd5-8820-40b7-802d-7b3e43f17440"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:31.920777 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-6a65d769-3770-465c-8b6f-6870236f9f97 req-8a8dd144-13d6-4e35-bbe8-c05e878ad216 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:31.921259 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-6a65d769-3770-465c-8b6f-6870236f9f97 req-8a8dd144-13d6-4e35-bbe8-c05e878ad216 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:31.921696 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-6a65d769-3770-465c-8b6f-6870236f9f97 req-8a8dd144-13d6-4e35-bbe8-c05e878ad216 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:31.934539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-6a65d769-3770-465c-8b6f-6870236f9f97 req-8a8dd144-13d6-4e35-bbe8-c05e878ad216 service nova] Creating event network-vif-deleted:0c4c8fd5-8820-40b7-802d-7b3e43f17440 for instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 on hv-cinder-85083 Aug 10 10:09:31.940125 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-6a65d769-3770-465c-8b6f-6870236f9f97 req-8a8dd144-13d6-4e35-bbe8-c05e878ad216 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038286 Aug 10 10:09:31.941206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 405/822] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:32.666642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:32.667293 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:32.673844 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:32.674336 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:32.674771 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:32.675499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:32.675961 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:32.676387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:32.691280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 HTTP/1.1 Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:09:32.693047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:32.694371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '5f6cb556-324b-440d-98cd-2532ad4cdc93'} Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:32.695175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:32.696345 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:32.697433 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:32.697433 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f960b222-843b-4853-9a0f-ce95cacf5d0d tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 404 len: 111 microversion: 2.1 time: 0.032113 Aug 10 10:09:32.697433 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 418/823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:32 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:32.704139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c58807c3-ddd9-439f-9cc8-61fc8e615a2c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '.version_select at 0x7f22fbfb9f70>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:32.724458 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c58807c3-ddd9-439f-9cc8-61fc8e615a2c tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720786773" status: 202 len: 0 microversion: 2.1 time: 0.024079 Aug 10 10:09:32.725267 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 406/824] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 10 10:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720786773 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:09:34.474708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:34.475246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:34.481545 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:34.482028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:34.482464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:34.483185 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:34.483638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:34.484067 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:34.497586 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 HTTP/1.1 Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:09:34.499090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.500969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '5f6cb556-324b-440d-98cd-2532ad4cdc93'} Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:34.502066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.504169 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.505752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:34.505752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e5cf589f-df85-4ca2-9b5d-6891a7d4b35e tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 404 len: 111 microversion: 2.1 time: 0.029605 Aug 10 10:09:34.505752 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 419/825] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:09:34 2022] DELETE /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:34.509593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:34.510336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 5f6cb556-324b-440d-98cd-2532ad4cdc93] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:34.519965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:34.520455 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:34.520899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:34.521593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:34.522055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:34.522488 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:34.535598 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 HTTP/1.1 Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:34.537204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.538721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '5f6cb556-324b-440d-98cd-2532ad4cdc93'} Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:34.539852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. Aug 10 10:09:34.541279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:34.542990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 5f6cb556-324b-440d-98cd-2532ad4cdc93 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:34.542990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d5c35479-23f4-481d-8503-f0e85f67c838 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93" status: 404 len: 111 microversion: 2.1 time: 0.032831 Aug 10 10:09:34.542990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 407/826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:34 2022] GET /compute/v2.1/servers/5f6cb556-324b-440d-98cd-2532ad4cdc93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:35.676687 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:35.677273 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:35.683672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.684157 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.684593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.685280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.685736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.686156 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.699698 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 HTTP/1.1 Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:09:35.701228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.702779 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'c6a806be-ce2e-41ba-bcac-a3934f0addc8'} Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:35.703906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.705342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.707626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:35.707626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1f201482-e1bd-4979-8d3c-6be975d5d1b5 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 404 len: 111 microversion: 2.1 time: 0.029754 Aug 10 10:09:35.707626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 420/827] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:09:35 2022] DELETE /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:35.711225 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:35.711871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: c6a806be-ce2e-41ba-bcac-a3934f0addc8] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:35.717985 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.718463 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.718899 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.719623 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.720076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.720503 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.733370 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 HTTP/1.1 Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:35.734871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.736405 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'c6a806be-ce2e-41ba-bcac-a3934f0addc8'} Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:35.737487 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. Aug 10 10:09:35.738916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.740368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance c6a806be-ce2e-41ba-bcac-a3934f0addc8 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:35.740368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-37eed959-5035-43bb-a0fa-430ad2569d47 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8" status: 404 len: 111 microversion: 2.1 time: 0.028691 Aug 10 10:09:35.740368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 408/828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:35 2022] GET /compute/v2.1/servers/c6a806be-ce2e-41ba-bcac-a3934f0addc8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:35.744503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:35.745003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:35.751084 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.751566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.752003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.753187 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.753641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.754067 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.767558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 HTTP/1.1 Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:09:35.769658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.771352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '14284420-f1ed-4de0-a217-90e8b43f96a0'} Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:35.772401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.774037 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.775793 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:35.775793 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-669522c9-3463-41da-9e39-40a6a1c1dd09 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 404 len: 111 microversion: 2.1 time: 0.030315 Aug 10 10:09:35.775793 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 421/829] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:09:35 2022] DELETE /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:35.779504 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:35.780115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 14284420-f1ed-4de0-a217-90e8b43f96a0] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:35.786327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.786809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.787271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.787960 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:35.788416 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:35.788841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:35.801645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 HTTP/1.1 Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:35.803201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.804792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '14284420-f1ed-4de0-a217-90e8b43f96a0'} Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:35.805941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. Aug 10 10:09:35.807506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:35.808953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 14284420-f1ed-4de0-a217-90e8b43f96a0 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:35.808953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0cfbe0bb-3658-43ae-b716-0254197c90e0 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0" status: 404 len: 111 microversion: 2.1 time: 0.029044 Aug 10 10:09:35.808953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 409/830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:35 2022] GET /compute/v2.1/servers/14284420-f1ed-4de0-a217-90e8b43f96a0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 10:09:36.944294 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:36.944777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:36.951106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:36.951592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:36.952028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:36.952716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:36.953171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:36.953600 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:36.966625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c HTTP/1.1 Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:09:36.968180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:36.969778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '50513b4b-53a2-4825-821b-07ff035fe17c'} Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:36.970815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:36.972288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:36.973812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:36.973812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4ef4696c-c42f-4c78-8ede-2d6e3952ef04 tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "DELETE /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 404 len: 111 microversion: 2.1 time: 0.029734 Aug 10 10:09:36.973812 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 422/831] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:09:36 2022] DELETE /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:36.977698 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:36.978315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] [instance: 50513b4b-53a2-4825-821b-07ff035fe17c] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:36.984635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:36.985119 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:36.985559 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:36.986255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:36.987217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:36.987657 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:37.000952 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] HTTP exception thrown: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Request method failure captured: Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c HTTP/1.1 Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84Jdl9MhTBcRWHlCsn-gg-EtC_W3KyhyCBHPONtY3SZVJIF3_3oraCVqihf7tN_eY8nmq1MrVy1H96IhDfe-Lr-jl5wyGOD0mwrIJMi-TbhxekAM0Jh99jxvnWdMR_YWlt_bbbqMGhZ_g3783MwCbbc-XxKax0ZWbtK_9QNGNoJJF6I Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:37.003184 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66439eb22e4a4938b0522bfd356ca3f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66439eb22e4a4938b0522bfd356ca3f9"}]}] Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 66439eb22e4a4938b0522bfd356ca3f9 Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1588747439 Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 2dd3653b931643318f1a1b0820620277 Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeNegativeTest-1588747439-project Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:37.004825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '50513b4b-53a2-4825-821b-07ff035fe17c'} Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:37.005843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. Aug 10 10:09:37.007325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:37.008691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] Returning 404 to user: Instance 50513b4b-53a2-4825-821b-07ff035fe17c could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:37.008691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d3eeb094-47ad-47f3-99a1-e3db11b010cc tempest-AttachVolumeNegativeTest-1588747439 tempest-AttachVolumeNegativeTest-1588747439-project] 10.222.0.20 "GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c" status: 404 len: 111 microversion: 2.1 time: 0.030661 Aug 10 10:09:37.008691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 410/832] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:09:36 2022] GET /compute/v2.1/servers/50513b4b-53a2-4825-821b-07ff035fe17c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:40.622118 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:40.622631 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:40.629381 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:40.629865 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:40.630503 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:40.631237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:40.631697 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:40.632125 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:40.656268 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cf5661be-ff8c-4ef5-8287-211d1235e798 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/ips" status: 200 len: 150 microversion: 2.20 time: 0.038018 Aug 10 10:09:40.656840 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 423/833] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 10 10:09:40 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:09:41.290412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8c603e74-c6ca-4489-98e0-5c5f5aa0bfce tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Action: 'create', calling method: .version_select at 0x7f22fbd8fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-753779280"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:41.569731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8c603e74-c6ca-4489-98e0-5c5f5aa0bfce tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.397076 Aug 10 10:09:41.570412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 411/834] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Aug 10 10:09:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 10:09:41.583943 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c704bd99-6df5-4335-831d-435c4cf0809f tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd80040>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:41.632172 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c704bd99-6df5-4335-831d-435c4cf0809f tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3" status: 200 len: 344 microversion: 2.1 time: 0.053096 Aug 10 10:09:41.632899 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 424/835] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:41 2022] GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:42.646620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-889c8d85-ee78-46a6-93b9-c11f1f51db79 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbccfa60>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:42.653499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:42.654199 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:42.661524 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:42.662019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:42.662464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:42.663205 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:42.663671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:42.664136 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:42.687662 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lazy-loading 'flavor' on Instance uuid b57896e7-150e-441c-a4ae-9c9f7d91227a {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:09:42.694736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-889c8d85-ee78-46a6-93b9-c11f1f51db79 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3" status: 200 len: 345 microversion: 2.1 time: 0.052461 Aug 10 10:09:42.695341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 412/836] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:42 2022] GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:42.708329 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-15fb6e12-3187-4535-8c5c-a07ac2abf9aa tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Action: 'create', calling method: .version_select at 0x7f22fbdfdc10>, body: {"snapshot": {"volume_id": "a80861fa-a65e-43c3-9eac-9f91799d1fb3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1696939001"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:42.873195 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-15fb6e12-3187-4535-8c5c-a07ac2abf9aa tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.168983 Aug 10 10:09:42.873773 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 413/837] 10.222.0.20 () {60 vars in 1162 bytes} [Wed Aug 10 10:09:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:42.881663 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5b8cb69d-ede7-449e-a31b-4a7f7d898684 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/action" status: 202 len: 0 microversion: 2.20 time: 0.232366 Aug 10 10:09:42.885620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 425/838] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 10 10:09:42 2022] POST /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 10:09:42.886237 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7a318d10-e39e-4cc9-ad4c-13ebfff1d13d tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd8f700>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:42.896031 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:42.897142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:42.907034 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:42.907539 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:42.907979 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:42.908721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:42.909178 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:42.909605 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:42.942136 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7a318d10-e39e-4cc9-ad4c-13ebfff1d13d tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 200 len: 287 microversion: 2.1 time: 0.060354 Aug 10 10:09:42.942703 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 414/839] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 10 10:09:42 2022] GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:42.953173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2f2f366e-b238-4db0-93c8-ed5f5c72d034 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbdc1d30>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:42.984473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2f2f366e-b238-4db0-93c8-ed5f5c72d034 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034804 Aug 10 10:09:42.985139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 415/840] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 10 10:09:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:42.996265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6e3e28d3-4118-42d7-ae4d-ee5637d7f26b tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbccf550>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:43.026691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6e3e28d3-4118-42d7-ae4d-ee5637d7f26b tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 200 len: 287 microversion: 2.1 time: 0.034081 Aug 10 10:09:43.027386 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 416/841] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 10 10:09:42 2022] GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:43.054587 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:43.062693 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:43.064271 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:43.066163 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-dc8520c9-405f-49eb-ac37-21690fb8f5e7 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.176298 Aug 10 10:09:43.066750 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 426/842] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:42 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:44.039775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d6aacd62-22e3-41e8-a595-d8711330a9b5 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd8fee0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:44.068674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d6aacd62-22e3-41e8-a595-d8711330a9b5 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 200 len: 287 microversion: 2.1 time: 0.033423 Aug 10 10:09:44.069217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 417/843] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 10 10:09:44 2022] GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:44.088620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:44.089230 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:44.095511 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:44.096025 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:44.096464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:44.097151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:44.097604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:44.098030 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:44.225517 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:44.233481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:44.235002 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:44.236151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a38cbf4b-5010-49e8-946f-0bfc417e5177 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.151380 Aug 10 10:09:44.236768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 427/844] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:44 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:45.081193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-799021eb-6661-4cef-ac8f-f87be075cec6 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbdef1f0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:45.113840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-799021eb-6661-4cef-ac8f-f87be075cec6 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 200 len: 287 microversion: 2.1 time: 0.037363 Aug 10 10:09:45.114437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 418/845] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 10 10:09:45 2022] GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:45.258875 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:45.259550 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:45.266314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:45.266803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:45.267341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:45.268531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:45.268982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:45.269408 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:45.393380 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:45.401559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:45.403209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:45.404367 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-10ad0827-06c9-4730-9b1f-d284655dddc0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.149395 Aug 10 10:09:45.404957 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 428/846] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:45 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:46.127787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fee1c6ec-6db3-47c2-ae42-a1e47b0a88a9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbdc15e0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:46.157108 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fee1c6ec-6db3-47c2-ae42-a1e47b0a88a9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 200 len: 288 microversion: 2.1 time: 0.034482 Aug 10 10:09:46.157669 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 419/847] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 10 10:09:46 2022] GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:46.168893 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f2726e50-3810-487c-b7ae-edf9d01a0498 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd898b0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:46.229778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f2726e50-3810-487c-b7ae-edf9d01a0498 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 202 len: 0 microversion: 2.1 time: 0.064540 Aug 10 10:09:46.230445 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 429/848] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Aug 10 10:09:46 2022] DELETE /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:09:46.239496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6e27e49c-0a6c-49b7-b23a-070e642710d8 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd4f160>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:46.268614 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6e27e49c-0a6c-49b7-b23a-070e642710d8 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 200 len: 287 microversion: 2.1 time: 0.033603 Aug 10 10:09:46.269183 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 420/849] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 10 10:09:46 2022] GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:46.428741 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:46.429367 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:46.435435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:46.435919 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:46.436360 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:46.437071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:46.437516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:46.437965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:46.578145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:46.586426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:46.587958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:46.589103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cb12ac53-bc98-4ad0-8cf1-0605d2164ec4 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.165427 Aug 10 10:09:46.589649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 430/850] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:46 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:09:47.278082 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:47.278975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:47.283197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23fdbcfe-4c2b-458d-bb49-0f22d5bef748 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbdfde50>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:47.309234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-23fdbcfe-4c2b-458d-bb49-0f22d5bef748 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] HTTP exception thrown: Snapshot 65f11cff-f022-4b5e-a88a-ee4711433fa8 could not be found. Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23fdbcfe-4c2b-458d-bb49-0f22d5bef748 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Request method failure captured: Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 HTTP/1.1 Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84PlLyt9DJizD5oPnB0VZa03UeyaKwW4W2EpMH1m1xQeLzznClqIiLMTk87Vr8MKm5YU9y0J1FGEnMIh3mzWg9HJXPtuzVbzv4Fb0ZjCV9civj_PsrXjGCy7Uf5oD9CVVRS30Ya9gY6zyiLx0BWr3LQZv8L1iqIxKdZoDmMlAKDLfT8 Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:47.311506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}] Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 182fd8ff60f145fbbc743e4d07650499 Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Snapshot 65f11cff-f022-4b5e-a88a-ee4711433fa8 could not be found. Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '65f11cff-f022-4b5e-a88a-ee4711433fa8'} Aug 10 10:09:47.312828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 65f11cff-f022-4b5e-a88a-ee4711433fa8 could not be found. (HTTP 404) (Request-ID: req-fd8cc67c-b6f1-4194-8e4e-dadf162ab0d6) Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:47.313628 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:47.314908 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 65f11cff-f022-4b5e-a88a-ee4711433fa8 could not be found. Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 10:09:47.316364 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 65f11cff-f022-4b5e-a88a-ee4711433fa8 could not be found. Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 65f11cff-f022-4b5e-a88a-ee4711433fa8 could not be found. Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23fdbcfe-4c2b-458d-bb49-0f22d5bef748 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Returning 404 to user: Snapshot 65f11cff-f022-4b5e-a88a-ee4711433fa8 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:47.317870 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-23fdbcfe-4c2b-458d-bb49-0f22d5bef748 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8" status: 404 len: 111 microversion: 2.1 time: 0.035739 Aug 10 10:09:47.318895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 421/851] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 10 10:09:47 2022] GET /compute/v2.1/os-snapshots/65f11cff-f022-4b5e-a88a-ee4711433fa8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:47.321491 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f2a369fc-2b02-4304-a4f3-67c3f24f7170 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbdfce50>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:47.379075 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f2a369fc-2b02-4304-a4f3-67c3f24f7170 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3" status: 202 len: 0 microversion: 2.1 time: 0.061119 Aug 10 10:09:47.379754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 431/852] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:09:47 2022] DELETE /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:09:47.388280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8b6b8af3-cc19-4743-bad9-ec7acae08199 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd4f820>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:47.435207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8b6b8af3-cc19-4743-bad9-ec7acae08199 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3" status: 200 len: 344 microversion: 2.1 time: 0.050739 Aug 10 10:09:47.435772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 422/853] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:47 2022] GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:47.612810 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:47.613429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:47.619284 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:47.619775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:47.620214 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:47.620940 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:47.621405 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:47.621841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:47.748860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:47.756971 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:47.758484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:47.759672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-96cd3c07-2ac4-4e17-b182-554fa0ee3ebd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.152033 Aug 10 10:09:47.760228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 432/854] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:47 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:48.450075 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-930ec761-e864-4f93-84ed-d2c802054ea9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbfb9670>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:48.477450 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-930ec761-e864-4f93-84ed-d2c802054ea9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] HTTP exception thrown: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-930ec761-e864-4f93-84ed-d2c802054ea9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Request method failure captured: Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 HTTP/1.1 Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84PlLyt9DJizD5oPnB0VZa03UeyaKwW4W2EpMH1m1xQeLzznClqIiLMTk87Vr8MKm5YU9y0J1FGEnMIh3mzWg9HJXPtuzVbzv4Fb0ZjCV9civj_PsrXjGCy7Uf5oD9CVVRS30Ya9gY6zyiLx0BWr3LQZv8L1iqIxKdZoDmMlAKDLfT8 Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:48.480724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}] Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 182fd8ff60f145fbbc743e4d07650499 Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'a80861fa-a65e-43c3-9eac-9f91799d1fb3'} Aug 10 10:09:48.482294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. (HTTP 404) (Request-ID: req-cab552a4-8b90-4ca2-abcd-24a79b14f4c5) Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.483299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:48.484757 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 10:09:48.486202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-930ec761-e864-4f93-84ed-d2c802054ea9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Returning 404 to user: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-930ec761-e864-4f93-84ed-d2c802054ea9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3" status: 404 len: 109 microversion: 2.1 time: 0.037199 Aug 10 10:09:48.488255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 423/855] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:48 2022] GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:48.494809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e7d3c55c-81c5-4f8e-a6b4-b1b6442f07a9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd89b80>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:48.522350 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-e7d3c55c-81c5-4f8e-a6b4-b1b6442f07a9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] HTTP exception thrown: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e7d3c55c-81c5-4f8e-a6b4-b1b6442f07a9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Request method failure captured: Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 HTTP/1.1 Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84PlLyt9DJizD5oPnB0VZa03UeyaKwW4W2EpMH1m1xQeLzznClqIiLMTk87Vr8MKm5YU9y0J1FGEnMIh3mzWg9HJXPtuzVbzv4Fb0ZjCV9civj_PsrXjGCy7Uf5oD9CVVRS30Ya9gY6zyiLx0BWr3LQZv8L1iqIxKdZoDmMlAKDLfT8 Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:09:48.524460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}] Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 182fd8ff60f145fbbc743e4d07650499 Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'a80861fa-a65e-43c3-9eac-9f91799d1fb3'} Aug 10 10:09:48.525993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. (HTTP 404) (Request-ID: req-c018cc57-62b1-4e5e-9d12-3b21f0257b89) Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.526938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 10:09:48.528234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 10:09:48.529448 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e7d3c55c-81c5-4f8e-a6b4-b1b6442f07a9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Returning 404 to user: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e7d3c55c-81c5-4f8e-a6b4-b1b6442f07a9 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3" status: 404 len: 109 microversion: 2.1 time: 0.034975 Aug 10 10:09:48.530709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 433/856] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:09:48 2022] DELETE /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:48.534945 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ed2da376-cb5f-4dba-b5be-b6ca2167b135 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Calling method '.version_select at 0x7f22fbd4f790>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:48.562658 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-ed2da376-cb5f-4dba-b5be-b6ca2167b135 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] HTTP exception thrown: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ed2da376-cb5f-4dba-b5be-b6ca2167b135 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Request method failure captured: Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 HTTP/1.1 Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84PlLyt9DJizD5oPnB0VZa03UeyaKwW4W2EpMH1m1xQeLzznClqIiLMTk87Vr8MKm5YU9y0J1FGEnMIh3mzWg9HJXPtuzVbzv4Fb0ZjCV9civj_PsrXjGCy7Uf5oD9CVVRS30Ya9gY6zyiLx0BWr3LQZv8L1iqIxKdZoDmMlAKDLfT8 Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:48.564716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c2f7a7de5d7b4e3aa1236c6a2d7bb060"}]}] Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: c2f7a7de5d7b4e3aa1236c6a2d7bb060 Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031272293 Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 182fd8ff60f145fbbc743e4d07650499 Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031272293-project Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'a80861fa-a65e-43c3-9eac-9f91799d1fb3'} Aug 10 10:09:48.566217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. (HTTP 404) (Request-ID: req-9f16d6ab-30e2-4e64-b8d3-27aabd539e50) Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.567216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:48.568714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 10:09:48.570146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ed2da376-cb5f-4dba-b5be-b6ca2167b135 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] Returning 404 to user: Volume a80861fa-a65e-43c3-9eac-9f91799d1fb3 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ed2da376-cb5f-4dba-b5be-b6ca2167b135 tempest-VolumesSnapshotsTestJSON-2031272293 tempest-VolumesSnapshotsTestJSON-2031272293-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3" status: 404 len: 109 microversion: 2.1 time: 0.035657 Aug 10 10:09:48.571507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 424/857] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:48 2022] GET /compute/v2.1/os-volumes/a80861fa-a65e-43c3-9eac-9f91799d1fb3 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:09:48.782253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:48.783120 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:48.792023 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:48.792759 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:48.793355 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:48.794231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:48.794717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:48.795171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:48.930512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:48.938407 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:48.939965 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:48.941114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a9ade6da-bfc2-45ff-bec0-29c0a852e7e2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.163203 Aug 10 10:09:48.941671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 434/858] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:48 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:09:49.896565 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-35c8f8d5-8cbd-46d2-933e-10a3812dae2f tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Action: 'create', calling method: .version_select at 0x7f22fbdefa60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1795230727", "metadata": {"Type": "work"}}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:09:49.964644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:49.965258 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:49.971844 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:49.972340 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:49.972782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:49.973484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:49.973947 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:49.974398 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:50.111662 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:50.121146 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:50.125326 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:50.127561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-04956b21-5dd0-4a19-ab29-ef4dda3c7c40 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.166122 Aug 10 10:09:50.128237 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 435/859] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:49 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:09:50.193193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-35c8f8d5-8cbd-46d2-933e-10a3812dae2f tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.406404 Aug 10 10:09:50.194153 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 425/860] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 10 10:09:49 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 10:09:50.207603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-171db278-b701-46c5-8942-b77f9225f644 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Calling method '.version_select at 0x7f22fbfe3940>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:50.258791 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-171db278-b701-46c5-8942-b77f9225f644 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103" status: 200 len: 353 microversion: 2.1 time: 0.055122 Aug 10 10:09:50.259501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 436/861] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:50 2022] GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:51.250408 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:51.251332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:51.257412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:51.257901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:51.258344 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:51.259166 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:51.259662 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:51.260207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:51.273892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ac75c69a-9448-4d08-9894-7da939de12da tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Calling method '.version_select at 0x7f22fbd89550>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:51.324044 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ac75c69a-9448-4d08-9894-7da939de12da tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103" status: 200 len: 354 microversion: 2.1 time: 0.054327 Aug 10 10:09:51.324692 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 437/862] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:51 2022] GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:51.336398 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bbe81384-4f61-4186-b44a-10cd27c0a5e9 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Calling method '.version_select at 0x7f23080a4dc0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:51.383407 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bbe81384-4f61-4186-b44a-10cd27c0a5e9 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103" status: 200 len: 354 microversion: 2.1 time: 0.050456 Aug 10 10:09:51.384130 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 438/863] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:51 2022] GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:09:51.394473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:51.401953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e98fc3dd-0039-4907-8074-098e84f297b0 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Calling method '.version_select at 0x7f22fbd89550>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:51.402847 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:51.404457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:51.405579 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-77b85eb4-1f30-4b20-896a-ce162285ceba tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.258204 Aug 10 10:09:51.406127 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 426/864] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:51 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:51.462810 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e98fc3dd-0039-4907-8074-098e84f297b0 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103" status: 202 len: 0 microversion: 2.1 time: 0.064557 Aug 10 10:09:51.463444 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 439/865] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:09:51 2022] DELETE /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:09:51.471677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b8eddf21-c5a7-4c61-8355-b1d1628ac2a3 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Calling method '.version_select at 0x7f22fbe1d040>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:51.517192 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b8eddf21-c5a7-4c61-8355-b1d1628ac2a3 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103" status: 200 len: 353 microversion: 2.1 time: 0.049535 Aug 10 10:09:51.518399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 427/866] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:51 2022] GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:09:52.429251 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:52.429870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:52.435905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:52.436388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:52.436826 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:52.437531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:52.437989 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:52.438419 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:52.532004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5eb16d44-cd47-4478-99e2-a1591f748cd9 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Calling method '.version_select at 0x7f22fbdef3a0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:52.560677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-5eb16d44-cd47-4478-99e2-a1591f748cd9 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] HTTP exception thrown: Volume cb1629fd-8260-473b-ac14-e0329fd3d103 could not be found. Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5eb16d44-cd47-4478-99e2-a1591f748cd9 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Request method failure captured: Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103 HTTP/1.1 Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84PtH1MMedN15aREE5E83Nx_UJVWGOqNwMwYm4qH8hfmTb-PvVyMhPCxLkLG5bbPvv48-74-5LSRtTSny0bLTWY6ugZGDSh42lkk-iVGKUccjoG_6CVxJFM4FR2nTR7UKUll31r7hHWSawQPtNoWlbSl5pR3XotxftAjvnYL2bg4ImE Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: bc1a0967d06e48d09b1d1ae452f71dbf Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-VolumesGetTestJSON-1258765280 Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:09:52.562663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bc1a0967d06e48d09b1d1ae452f71dbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc1a0967d06e48d09b1d1ae452f71dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bc1a0967d06e48d09b1d1ae452f71dbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bc1a0967d06e48d09b1d1ae452f71dbf"}]}] Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-VolumesGetTestJSON-1258765280 Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: bc1a0967d06e48d09b1d1ae452f71dbf Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-VolumesGetTestJSON-1258765280 Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-VolumesGetTestJSON-1258765280-project Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 9a943e449a5e4be197970c3263d21d68 Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-VolumesGetTestJSON-1258765280-project Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Volume cb1629fd-8260-473b-ac14-e0329fd3d103 could not be found. Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'cb1629fd-8260-473b-ac14-e0329fd3d103'} Aug 10 10:09:52.564265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb1629fd-8260-473b-ac14-e0329fd3d103 could not be found. (HTTP 404) (Request-ID: req-a6a14ab5-d045-4717-8903-13e6ebf89d32) Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:52.565319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 10:09:52.566806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb1629fd-8260-473b-ac14-e0329fd3d103 could not be found. Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 10:09:52.568290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb1629fd-8260-473b-ac14-e0329fd3d103 could not be found. Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb1629fd-8260-473b-ac14-e0329fd3d103 could not be found. Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5eb16d44-cd47-4478-99e2-a1591f748cd9 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] Returning 404 to user: Volume cb1629fd-8260-473b-ac14-e0329fd3d103 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5eb16d44-cd47-4478-99e2-a1591f748cd9 tempest-VolumesGetTestJSON-1258765280 tempest-VolumesGetTestJSON-1258765280-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103" status: 404 len: 109 microversion: 2.1 time: 0.036443 Aug 10 10:09:52.569620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 428/867] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 10 10:09:52 2022] GET /compute/v2.1/os-volumes/cb1629fd-8260-473b-ac14-e0329fd3d103 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 10:09:52.570743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:52.576748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:52.578276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:52.579483 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e1361f58-38c9-49af-a116-e1448552078e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.154737 Aug 10 10:09:52.580846 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 440/868] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:52 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:53.603362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:53.603917 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:53.609768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:53.610264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:53.610802 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:53.611420 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:53.611878 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:53.612310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:53.745900 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:53.754704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:53.756227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:53.757375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b97c28d3-cb52-4e6a-8d47-64730a599721 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.158388 Aug 10 10:09:53.757920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 429/869] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:53 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:54.780804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:54.781417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:54.787754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:54.788254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:54.788674 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:54.789358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:54.789811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:54.790236 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:54.919185 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:54.927498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:54.929008 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:54.930165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4ed2b2d9-446e-4ab1-87d6-ca6e6ece61fe tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.153258 Aug 10 10:09:54.930783 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 441/870] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:54 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:55.953438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:55.954053 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:55.961268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:55.961652 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:55.962091 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:55.962794 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:55.963280 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:55.963715 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:56.093641 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:56.101767 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:56.103978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:56.105137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0a473b77-77a8-4130-92ef-97197e0466b8 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.155526 Aug 10 10:09:56.105684 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 430/871] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:55 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:57.127617 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:57.128226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:57.134076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:57.134590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:57.135063 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:57.135754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:57.136207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:57.136636 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:57.264204 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:57.272500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:57.274010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:57.275191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-57d2ffd7-e19b-4362-82eb-eaf85a524722 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.151895 Aug 10 10:09:57.275742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 442/872] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:57 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:58.297952 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:58.299986 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:58.306573 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:58.307103 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:58.307590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:58.308300 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:58.308913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:58.309355 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:58.448872 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:58.457676 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:58.459206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:58.460414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-96e2185d-b491-45d6-b299-74e6af7b795d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.166635 Aug 10 10:09:58.460972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 431/873] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:58 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:09:59.483811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:09:59.484430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:09:59.488551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=40 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:59.492436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:59.492929 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:59.493374 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:59.494114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:09:59.494565 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:09:59.495015 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:09:59.514824 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:59.627696 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:59.635984 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:59.637490 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:09:59.638640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b0a6ada8-b125-4fe1-8425-310b74153e5f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1742 microversion: 2.20 time: 0.158746 Aug 10 10:09:59.639399 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 443/874] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:09:59 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:00.661918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:00.662617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:00.668959 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:00.669442 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:00.669880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:00.670570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:00.671045 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:00.671473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:00.804737 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:00.812788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:00.814417 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:00.815606 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0b63b6d2-30ad-4da8-96b4-f4a48cc59b11 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.158047 Aug 10 10:10:00.816148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 432/875] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:00 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:01.841481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:01.842821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:01.849917 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:01.850623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:01.851106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:01.851843 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:01.852341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:01.852784 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:02.004415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:02.013056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:02.014620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:02.015833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6b2f3216-466f-4044-a5a7-8589b1cda888 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.178279 Aug 10 10:10:02.016718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 444/876] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:01 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:03.040129 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:03.041365 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:03.048463 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:03.048964 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:03.049444 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:03.050151 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:03.050617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:03.051082 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:03.192520 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:03.201741 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:03.203789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:03.205501 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-96770330-7bd3-495a-8053-4c35b1176578 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.169147 Aug 10 10:10:03.206282 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 433/877] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:03 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:04.229934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:04.231277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:04.239028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:04.239796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:04.240450 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:04.241402 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:04.242077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:04.242721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:04.551653 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:04.566299 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:04.568002 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:04.569751 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-7475a659-5fcf-408a-98f2-96e26ffbbdf8 req-1a8c55b8-4a4b-46b6-85af-0f2cd907738d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57896e7-150e-441c-a4ae-9c9f7d91227a", "name": "network-vif-plugged", "status": "completed", "tag": "5096bd70-a7a2-459b-b55a-d5cca428c770"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:04.570407 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9fd04b97-774a-47a1-a39b-b58ce0546391 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.344096 Aug 10 10:10:04.582142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-7475a659-5fcf-408a-98f2-96e26ffbbdf8 req-1a8c55b8-4a4b-46b6-85af-0f2cd907738d service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:04.583027 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-7475a659-5fcf-408a-98f2-96e26ffbbdf8 req-1a8c55b8-4a4b-46b6-85af-0f2cd907738d service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:04.583636 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-7475a659-5fcf-408a-98f2-96e26ffbbdf8 req-1a8c55b8-4a4b-46b6-85af-0f2cd907738d service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:04.590909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 445/878] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:04 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:04.603747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-7475a659-5fcf-408a-98f2-96e26ffbbdf8 req-1a8c55b8-4a4b-46b6-85af-0f2cd907738d service nova] Creating event network-vif-plugged:5096bd70-a7a2-459b-b55a-d5cca428c770 for instance b57896e7-150e-441c-a4ae-9c9f7d91227a on hv-cinder-85083 Aug 10 10:10:04.613357 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-7475a659-5fcf-408a-98f2-96e26ffbbdf8 req-1a8c55b8-4a4b-46b6-85af-0f2cd907738d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044678 Aug 10 10:10:04.617077 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 434/879] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:10:04.687145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:04.687679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:04.696366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:04.696831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:04.697274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:04.697981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:04.698439 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:04.698866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:04.729324 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3a874fe1-d9e3-448d-aa8c-c5c8f17479e3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/ips" status: 200 len: 146 microversion: 2.1 time: 0.046096 Aug 10 10:10:04.730278 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 446/880] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:10:04 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:10:05.602393 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:05.603132 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:05.613889 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:05.614827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:05.615537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:05.616249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:05.616918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:05.617450 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:05.767992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:05.782477 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:05.784952 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:05.786680 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3dd8073b-f354-4fa3-8f8a-fb894c28271d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.190042 Aug 10 10:10:05.787746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 435/881] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:05 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:10:06.811626 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:06.812437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:06.822022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:06.822538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:06.823113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:06.823963 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:06.824622 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:06.825062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:06.978652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:06.988341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:06.990125 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:06.991564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-83f419d2-9c4c-409f-8672-e3cf91ea0061 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.184182 Aug 10 10:10:06.992130 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 447/882] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:06 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:08.016329 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:08.018171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:08.025243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:08.025996 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:08.026645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:08.027570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:08.028189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:08.028838 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:08.180846 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:08.190039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:08.191589 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:08.192761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0ce50d68-3a59-4cc7-9c12-aafa1716b643 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.180346 Aug 10 10:10:08.193326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 436/883] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:08 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:09.216274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:09.217533 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:09.225099 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:09.225766 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:09.226208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:09.226943 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:09.227482 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:09.227913 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:09.381611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:09.389743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:09.391338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:09.393269 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cedd080b-8a19-4ce2-b0f5-0d955c6fc0c3 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.181265 Aug 10 10:10:09.393859 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 448/884] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:09 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:09.968264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80ab6323-ac26-4a3f-b85f-d18791dc0b50"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:09.971969 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:09.978881 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:09.979472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:09.979950 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:09.980748 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:09.981240 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:09.981707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:10.275167 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a0e629c5-f580-4293-9813-c2b24d679a06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310938 Aug 10 10:10:10.277879 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 437/885] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:10:09 2022] POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:10:10.416191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:10.416742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:10.423086 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:10.424079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:10.424508 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:10.425194 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:10.425645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:10.426066 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:10.557678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:10.566223 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:10.567774 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:10.568932 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-929f0c4b-6425-41d6-bf63-727ba44ba2bf tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1737 microversion: 2.20 time: 0.156673 Aug 10 10:10:10.569493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 449/886] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:10 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:11.592360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:11.593053 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:11.600445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:11.600928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:11.601371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:11.602124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:11.602524 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:11.602946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:11.730386 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:11.739215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:11.740789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:11.741943 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5ec4abad-332d-48da-85f8-1660c6f23b29 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1719 microversion: 2.20 time: 0.153934 Aug 10 10:10:11.742501 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 438/887] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:11 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:12.764834 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:12.765450 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:12.771890 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:12.772381 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:12.772822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:12.773513 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:12.773975 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:12.774406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:12.902600 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:12.910505 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:12.912041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:12.913203 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-47cc0092-64df-45d8-9a5f-f4fdbfa26602 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1719 microversion: 2.20 time: 0.152321 Aug 10 10:10:12.913756 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 450/888] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:12 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:13.936197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:13.936814 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:13.943789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:13.944275 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:13.944718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:13.945414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:13.945871 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:13.946299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:14.070142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:14.078106 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:14.079787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:14.080938 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-49e6987f-4ba7-49d0-9c6d-f4b4db4ae8cb tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1719 microversion: 2.20 time: 0.148657 Aug 10 10:10:14.081495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 439/889] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:13 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:15.104755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:15.105970 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:15.113243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:15.113736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:15.114180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:15.114885 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:15.115381 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:15.115813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:15.216588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-acf440e7-d873-45ba-947d-da83c9ba6496 req-91d9d594-d3b1-4e14-b630-e16a90238647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57896e7-150e-441c-a4ae-9c9f7d91227a", "name": "network-vif-unplugged", "status": "completed", "tag": "5096bd70-a7a2-459b-b55a-d5cca428c770"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:15.230787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-acf440e7-d873-45ba-947d-da83c9ba6496 req-91d9d594-d3b1-4e14-b630-e16a90238647 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:15.231593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-acf440e7-d873-45ba-947d-da83c9ba6496 req-91d9d594-d3b1-4e14-b630-e16a90238647 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:15.232264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-acf440e7-d873-45ba-947d-da83c9ba6496 req-91d9d594-d3b1-4e14-b630-e16a90238647 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:15.245454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.compute.server_external_events [req-acf440e7-d873-45ba-947d-da83c9ba6496 req-91d9d594-d3b1-4e14-b630-e16a90238647 service nova] Unable to find a host for instance b57896e7-150e-441c-a4ae-9c9f7d91227a. Dropping event network-vif-unplugged {{(pid=117896) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 10:10:15.246894 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-acf440e7-d873-45ba-947d-da83c9ba6496 req-91d9d594-d3b1-4e14-b630-e16a90238647 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034920 Aug 10 10:10:15.248136 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 440/890] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 10:10:15.256082 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:15.265642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:15.267465 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:15.269122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-243ed1f2-a930-427b-a373-cc81cf20e65c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1662 microversion: 2.20 time: 0.168168 Aug 10 10:10:15.269822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 451/891] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:15 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:15.293671 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1946e8c7-2baa-4c2d-b2b3-c2ef54c28d41"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:15.296378 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:15.303079 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:15.303692 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:15.304224 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:15.311439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:15.311920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:15.312360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:15.569912 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:15.576511 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e55fc826-c784-483d-bfbb-15393cc9c3af tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287053 Aug 10 10:10:15.577126 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 441/892] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Aug 10 10:10:15 2022] POST /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 10:10:15.704280 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:15.704782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:15.710603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:15.711175 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:15.711559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:15.712251 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:15.712710 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:15.713137 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:15.960982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fcf0289f-16a0-4efa-bc70-408897a834ab tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-volume_attachments/1946e8c7-2baa-4c2d-b2b3-c2ef54c28d41" status: 202 len: 0 microversion: 2.20 time: 0.260598 Aug 10 10:10:15.961565 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 452/893] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Aug 10 10:10:15 2022] DELETE /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-volume_attachments/1946e8c7-2baa-4c2d-b2b3-c2ef54c28d41 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 10:10:16.019954 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:16.020556 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:16.027707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:16.028194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:16.028635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:16.029327 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:16.029787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:16.030213 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:16.072772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117896) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 10:10:16.137688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-665dc4e6-ea33-4c52-9915-5cd1213be64c tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "POST /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/action" status: 202 len: 0 microversion: 2.20 time: 0.121799 Aug 10 10:10:16.138207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 442/894] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 10 10:10:16 2022] POST /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:10:16.146851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:16.147493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:16.154590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:16.155119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:16.155571 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:16.156389 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:16.157211 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:16.157849 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:16.317555 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:16.325635 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:16.327267 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:16.328420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0d2ca565-9e4b-4c4d-85b9-e9b13638ebd6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1670 microversion: 2.20 time: 0.185442 Aug 10 10:10:16.328968 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 453/895] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:16 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1670 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:17.352201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:17.352812 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:17.355147 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:17.360990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:17.361470 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:17.361913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:17.362600 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:17.363089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:17.363519 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:17.488233 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:17.495974 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:17.497463 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:17.498747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-edb21adb-5adc-423f-b1b9-3c2640874f2a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.150335 Aug 10 10:10:17.499329 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 443/896] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:17 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:17.795588 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8e5a7194-f430-439b-9d7c-540c12efe1a7 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:17.802569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8e5a7194-f430-439b-9d7c-540c12efe1a7 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:17.803095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8e5a7194-f430-439b-9d7c-540c12efe1a7 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:17.803539 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8e5a7194-f430-439b-9d7c-540c12efe1a7 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:17.860134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8e5a7194-f430-439b-9d7c-540c12efe1a7 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Going to try to stop instance {{(pid=117895) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 10:10:17.902901 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8e5a7194-f430-439b-9d7c-540c12efe1a7 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action" status: 202 len: 0 microversion: 2.1 time: 0.111103 Aug 10 10:10:17.903530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 454/897] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:10:17 2022] POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:10:17.911488 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:17.912175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:17.918090 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:17.918646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:17.919115 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:17.919954 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:17.920700 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:17.921367 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:18.045188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:18.053489 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-aaf16dab-69f9-427e-85c2-efd7ccaa2e9e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.145830 Aug 10 10:10:18.054051 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 444/898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:17 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:18.522905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:18.523590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:18.529649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:18.530165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:18.530608 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:18.531341 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:18.531801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:18.532263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:18.661245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:18.669252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:18.670817 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:18.671992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-498e9609-7e43-4519-a0e7-cf770826d484 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.153515 Aug 10 10:10:18.672542 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 455/899] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:18 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:19.075315 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:19.075905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:19.082324 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:19.082808 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:19.083282 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:19.083972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:19.084426 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:19.084852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:19.210882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:19.218713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-873d45c6-4cb8-4e56-a660-fd102cbc179d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.147337 Aug 10 10:10:19.219305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 445/900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:19 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:19.695920 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:19.696495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:19.702806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:19.703315 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:19.703755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:19.704488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:19.704943 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:19.705373 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:19.835328 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:19.843065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:19.844573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:19.846224 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b4e80be1-235f-4259-b88d-9cb65d53b256 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.154318 Aug 10 10:10:19.846780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 456/901] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:19 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:20.240562 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:20.241120 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:20.247561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:20.248045 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:20.248483 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:20.249171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:20.249625 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:20.250052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:20.382269 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:20.390206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-208ace62-5375-4a19-a196-3e835be4e576 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.153578 Aug 10 10:10:20.390770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 446/902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:20 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:20.869396 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:20.869995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:20.876568 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:20.877072 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:20.877514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:20.878221 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:20.878676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:20.879130 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:20.883118 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:21.010371 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:21.018863 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:21.020435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:21.021797 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0716f149-6319-43b1-90bc-fbd3a9acf762 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.156307 Aug 10 10:10:21.022353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 457/903] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:20 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:21.411785 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:21.412285 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:21.419654 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:21.420354 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:21.421005 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:21.421922 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:21.422568 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:21.423230 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:21.591173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:21.600593 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9dca8f89-6bb8-471a-b582-0282e634217d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.192772 Aug 10 10:10:21.614976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 447/904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:21 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:22.045900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:22.046519 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:22.053401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:22.053897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:22.054340 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:22.055073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:22.055531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:22.055968 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:22.184743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:22.192776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:22.194277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:22.195469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cc23e74d-495b-46ed-9970-8a60fec40df0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.153658 Aug 10 10:10:22.196017 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 458/905] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:22 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:22.624030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:22.624608 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:22.631561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:22.632045 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:22.632517 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:22.633447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:22.634095 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:22.634532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:22.767054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:22.775147 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9992f1a0-85c6-4609-84a9-54d554f7bf59 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.154938 Aug 10 10:10:22.775790 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 448/906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:22 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:23.218883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:23.219633 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:23.226919 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:23.227446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:23.227909 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:23.228814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:23.229276 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:23.229708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:23.362648 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:23.371033 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:23.372795 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:23.374156 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-638258cd-9b5c-4d02-b0d9-1802a942c8ee tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.160357 Aug 10 10:10:23.387002 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 459/907] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:23 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:23.800706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:23.801331 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:23.808145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:23.808646 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:23.809094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:23.809821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:23.810496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:23.810973 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:24.180175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:24.190848 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3685be09-f311-46e7-8f27-80539484f111 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.394856 Aug 10 10:10:24.191785 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 449/908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:23 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:24.398510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:24.400266 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:24.408606 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:24.409109 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:24.409625 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:24.410370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:24.410896 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:24.411635 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:24.540437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:24.548559 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:24.550073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:24.551272 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0ac68b71-5564-4ee1-ae72-0ee553db66cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.156884 Aug 10 10:10:24.551831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 460/909] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:24 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:25.212857 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:25.213570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:25.221174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:25.221794 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:25.222346 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:25.223179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:25.223734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:25.224260 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:25.356283 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:25.370060 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-feddf19c-0f97-4c48-84d8-c819a54f9212 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.160956 Aug 10 10:10:25.371372 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 450/910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:25 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:25.574512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:25.575180 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:25.581883 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:25.582379 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:25.582818 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:25.583549 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:25.584010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:25.584443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:25.737612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:25.745693 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:25.747399 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:25.748566 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-05e4a5d8-ebd7-4c32-94e2-71df08f3892a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.177976 Aug 10 10:10:25.749110 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 461/911] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:25 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:26.394663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:26.396268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:26.403711 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:26.405150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:26.405924 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:26.406875 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:26.407553 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:26.408197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:26.557007 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:26.567249 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f6013a58-7c2e-48aa-937f-c24e5718aedb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.177408 Aug 10 10:10:26.568117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 451/912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:26 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:26.773460 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:26.774292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:26.781330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:26.781902 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:26.783208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:26.783745 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:26.784211 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:26.784637 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:26.927134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:26.936089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:26.937604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:26.938815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-362a1f2d-5720-4f71-a605-b62dc8104cca tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.170092 Aug 10 10:10:26.939390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 462/913] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:26 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:27.594264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:27.596054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:27.603404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:27.603979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:27.604494 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:27.605289 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:27.605949 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:27.606616 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:27.746054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:27.754875 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-46b5c564-187c-476d-b927-3dc5ea169fa9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.165721 Aug 10 10:10:27.755732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 452/914] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:27 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:27.962796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:27.966361 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:27.982946 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:27.983481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:27.983933 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:27.984664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:27.985643 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:27.986092 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:28.154260 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:28.163116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:28.164670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:28.165841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b8947a09-d615-4332-ae21-65c5a112e8b6 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.207427 Aug 10 10:10:28.166411 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 463/915] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:27 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:28.775621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:28.776194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:28.783298 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:28.783788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:28.784235 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:28.784942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:28.785407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:28.785844 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:28.932771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:28.941230 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-7e6712fd-0cbe-4b63-96fe-0ccf91da2714 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.169625 Aug 10 10:10:28.941791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 453/916] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:28 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:29.190073 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:29.190685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:29.197095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:29.197587 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:29.198030 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:29.198724 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:29.199215 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:29.199652 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:29.335681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:29.343831 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:29.345611 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:29.346942 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b8f78e59-53a0-44b4-9eec-fb9f58cc91a1 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.161409 Aug 10 10:10:29.358982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 464/917] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:29 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:29.962944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:29.964460 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:29.991993 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:29.993124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:29.993756 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:29.994535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:29.995028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:29.995459 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:30.133975 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:30.143444 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3c4ac047-6fe2-4f35-9f32-ad176e4de321 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.184941 Aug 10 10:10:30.144476 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 454/918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:29 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:30.370814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:30.371463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:30.373783 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=44 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:30.380227 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:30.380721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:30.381176 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:30.381932 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:30.382346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:30.382782 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:30.510306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:30.518271 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:30.519824 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:30.520994 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9b8afbbf-d48c-4460-be60-91561d1a1ef2 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.154118 Aug 10 10:10:30.521585 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 465/919] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:30 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:31.172277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:31.174035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:31.182588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:31.183424 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:31.184165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:31.185122 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:31.185825 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:31.186510 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:31.372462 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:31.383227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-635b50e6-c609-4b13-975f-7a0133063767 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.216427 Aug 10 10:10:31.406150 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 455/920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:31 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:31.545065 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:31.545675 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:31.552718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:31.553209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:31.553651 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:31.554356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:31.554817 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:31.555463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:31.692658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:31.700627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:31.702446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:31.703753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-7292075b-1ba7-4a54-9cbf-d53b89734b61 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.162678 Aug 10 10:10:31.704317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 466/921] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:31 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:32.405703 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:32.407954 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:32.414972 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:32.415479 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:32.415923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:32.416626 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:32.417090 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:32.417544 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:32.546524 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:32.554584 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-46d637f1-f795-46bf-8f98-6fa24b6a1ded tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.152859 Aug 10 10:10:32.555371 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 456/922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:32 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:32.726590 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:32.727234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:32.733546 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:32.734028 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:32.734466 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:32.735210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:32.736141 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:32.736576 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:32.871012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:32.879972 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:32.881513 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:32.882678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1cb1beea-a203-46d1-bf8f-c94e3e34155d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.160019 Aug 10 10:10:32.883471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 467/923] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:32 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:33.576600 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:33.577159 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:33.584302 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:33.584862 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:33.585352 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:33.586089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:33.586602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:33.587074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:33.605809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:33.737867 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:33.745802 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ad59bb49-19ef-4319-be11-991ac90a4727 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.173157 Aug 10 10:10:33.746360 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 457/924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:33 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:33.907370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:33.908101 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:33.914421 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:33.914912 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:33.915378 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:33.916064 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:33.916547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:33.916952 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:34.050052 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:34.057867 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:34.059400 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:34.060544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cbe37c1a-28a1-49b0-9853-8f09916ef556 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.157339 Aug 10 10:10:34.061094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 468/925] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:33 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:34.767932 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:34.768545 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:34.774885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:34.775398 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:34.775888 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:34.776715 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:34.777196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:34.777627 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:34.912054 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:34.921430 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f0cc0cd1-1fc7-4abf-9982-221afa6afe7c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.157514 Aug 10 10:10:34.927391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 458/926] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:34 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:35.084453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:35.085079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:35.091469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:35.091966 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:35.092417 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:35.093124 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:35.093591 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:35.094029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:35.220292 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:35.228558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:35.230090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:35.231288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5457b147-74e3-4dcc-b435-08536102790a tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.150781 Aug 10 10:10:35.231985 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 469/927] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:35 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:35.943563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:35.944092 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:35.950459 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:35.950945 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:35.951415 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:35.952110 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:35.952570 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:35.953000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:36.087556 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:36.096388 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f2367fa9-6cbb-424a-a3d8-e629bb3c09b5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.156793 Aug 10 10:10:36.097050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 459/928] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:35 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:36.253825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:36.254443 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:36.260934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:36.261430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:36.261876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:36.262645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:36.263317 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:36.263866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:36.399768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:36.408119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:36.409642 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:36.410899 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d11adeae-15ef-47ec-bcee-458b83168400 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.161242 Aug 10 10:10:36.423140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 470/929] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:36 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:37.118892 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:37.119543 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:37.126114 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:37.126602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:37.127079 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:37.127772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:37.128239 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:37.128672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:37.261212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:37.269939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-89203d33-167a-4100-aea8-c619dd0ea533 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.154940 Aug 10 10:10:37.270523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 460/930] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:37 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:37.391479 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-728e2481-8135-42f3-b4ee-6c53189bd66a req-c95a7b61-2a98-4993-ab50-cbab0a8c2abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57896e7-150e-441c-a4ae-9c9f7d91227a", "name": "network-vif-plugged", "status": "completed", "tag": "5096bd70-a7a2-459b-b55a-d5cca428c770"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:37.402116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-728e2481-8135-42f3-b4ee-6c53189bd66a req-c95a7b61-2a98-4993-ab50-cbab0a8c2abf service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:37.402596 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-728e2481-8135-42f3-b4ee-6c53189bd66a req-c95a7b61-2a98-4993-ab50-cbab0a8c2abf service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:37.403062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-728e2481-8135-42f3-b4ee-6c53189bd66a req-c95a7b61-2a98-4993-ab50-cbab0a8c2abf service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:37.415289 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-728e2481-8135-42f3-b4ee-6c53189bd66a req-c95a7b61-2a98-4993-ab50-cbab0a8c2abf service nova] Creating event network-vif-plugged:5096bd70-a7a2-459b-b55a-d5cca428c770 for instance b57896e7-150e-441c-a4ae-9c9f7d91227a on hv-cinder-85083 Aug 10 10:10:37.420365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-728e2481-8135-42f3-b4ee-6c53189bd66a req-c95a7b61-2a98-4993-ab50-cbab0a8c2abf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Aug 10 10:10:37.420857 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 471/931] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:10:37.435544 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:37.436263 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:37.442256 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:37.442832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:37.443536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:37.444477 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:37.445015 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:37.445525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:37.583575 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:37.591916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:37.593426 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:37.594621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-abda0628-aacd-4442-832e-59e9231a9a12 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.163136 Aug 10 10:10:37.595216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 461/932] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:37 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:38.291363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:38.292263 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:38.298394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:38.298882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:38.299354 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:38.300053 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:38.300523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:38.300956 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:38.452924 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:38.461735 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-aeb918e3-e8ac-4c91-9bd5-e37327ff0016 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.174500 Aug 10 10:10:38.462390 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 472/933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:38 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:38.618028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:38.618645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:38.625172 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:38.625919 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:38.626361 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:38.627098 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:38.627561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:38.627995 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:38.766674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:38.778047 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:38.779573 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:38.780788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-efd83e9f-9bef-4946-9b94-5eb544bb8d8f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1728 microversion: 2.20 time: 0.166645 Aug 10 10:10:38.781356 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 462/934] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:38 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:39.482860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:39.483701 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:39.490394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:39.491050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:39.491601 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:39.492429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:39.493020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:39.493551 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:39.631571 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:39.640069 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1336c916-1fcf-4e39-bed6-9827cfa5a9fb tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.161176 Aug 10 10:10:39.640633 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 473/935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:39 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:39.805134 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:39.805733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:39.812220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:39.812715 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:39.813196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:39.813902 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:39.814366 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:39.815425 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:39.963419 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:39.972532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:39.974074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:39.975298 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-037d50b3-a8b8-4a0c-bedf-3c43f682e61f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1715 microversion: 2.20 time: 0.173951 Aug 10 10:10:39.976219 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 463/936] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:10:39 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:10:40.661621 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:40.662166 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:40.668554 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:40.669041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:40.669484 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:40.670167 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:40.670623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:40.671077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:40.685770 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=100 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:40.804116 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:40.811951 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-797ecf94-c6d8-4460-b0b5-6cd82a59d258 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.154305 Aug 10 10:10:40.812510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 474/937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:40 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:41.833230 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:41.833890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:41.840447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:41.840936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:41.841380 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:41.842074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:41.842537 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:41.843104 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:41.972851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:41.980780 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0e2759aa-e308-4f9d-b190-c09dda1ce4da tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.152019 Aug 10 10:10:41.981349 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 464/938] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:41 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:43.003384 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:43.003911 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:43.010233 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:43.010722 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:43.011203 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:43.011903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:43.012364 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:43.012799 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:43.142349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:43.150191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3af3990a-a72a-4bf4-8117-12f291b16c82 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.151704 Aug 10 10:10:43.150755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 475/939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:42 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:44.171613 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:44.172240 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:44.179202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:44.179691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:44.180135 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:44.180832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:44.181294 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:44.181726 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:44.310008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:44.318495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-780fc324-1be8-4f70-ac73-8d8c14792bd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1724 microversion: 2.1 time: 0.150750 Aug 10 10:10:44.319116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 465/940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:44 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:45.339702 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:45.340436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:45.347259 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:45.347742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:45.348181 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:45.348870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:45.349325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:45.349754 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:45.480848 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:45.489478 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-729fe6ba-b927-42fc-920a-621a9f8fd32c tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1701 microversion: 2.1 time: 0.153684 Aug 10 10:10:45.489975 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 476/941] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:45 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:10:45.509775 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4e002d52-b924-484d-8360-ef5351778a76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:10:45.516338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e002d52-b924-484d-8360-ef5351778a76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:45.516827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e002d52-b924-484d-8360-ef5351778a76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:45.517271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e002d52-b924-484d-8360-ef5351778a76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:45.595038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4e002d52-b924-484d-8360-ef5351778a76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Going to try to start instance {{(pid=117896) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 10:10:45.635839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4e002d52-b924-484d-8360-ef5351778a76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action" status: 202 len: 0 microversion: 2.1 time: 0.129809 Aug 10 10:10:45.636447 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 466/942] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:10:45 2022] POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:10:45.645113 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:45.645805 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:45.652088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:45.652574 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:45.653014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:45.653795 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:45.654163 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:45.654594 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:45.788992 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:45.796899 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ee0b0f56-7aa4-405a-8d1b-a3a27bb80398 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1710 microversion: 2.1 time: 0.156207 Aug 10 10:10:45.797458 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 477/943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:45 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:46.819039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:46.819746 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:46.825803 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:46.826291 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:46.826733 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:46.827457 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:46.827917 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:46.828348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:46.957800 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:46.965718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c045dfa4-632d-4aef-b57e-ccdcf8989c5b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1710 microversion: 2.1 time: 0.151428 Aug 10 10:10:46.966279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 467/944] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:46 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:10:47.987828 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:10:47.988673 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:10:47.995581 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:47.996078 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:47.996525 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:47.997285 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:10:47.997721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:10:47.998134 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:10:48.149104 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:10:48.157658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6d606dd4-7548-456e-863f-340ff7cb1bba tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1714 microversion: 2.1 time: 0.174029 Aug 10 10:10:48.158899 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 478/945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:10:47 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1714 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:13.608490 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:13.609073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:13.612046 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=49 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:13.612702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:13.619296 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:13.619795 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:13.620244 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:13.620951 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:13.621420 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:13.621863 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:13.645433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lazy-loading 'flavor' on Instance uuid 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:11:13.713188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dfdbecd4-6bcf-4b40-994d-a07dcc79a44a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "POST /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3/action" status: 202 len: 0 microversion: 2.1 time: 0.108648 Aug 10 10:11:13.713793 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 468/946] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:11:13 2022] POST /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:11:13.722588 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:13.723234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:13.725615 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=27 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:13.726501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=27 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:13.731870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:13.732362 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:13.732806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:13.733514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:13.733974 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:13.734402 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:13.865798 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:13.873200 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-96d9f50c-fdb3-4d39-8f1b-336ce39571dd tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.155017 Aug 10 10:11:13.873771 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 479/947] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:13 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:14.895679 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:14.896377 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:14.902412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:14.902896 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:14.903515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:14.904093 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:14.904551 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:14.904974 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:15.043098 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:15.050704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f5c514ad-ae56-457a-a192-073215bc1028 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.160607 Aug 10 10:11:15.051540 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 469/948] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:14 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:16.071572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:16.072226 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:16.078749 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:16.079271 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:16.079720 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:16.080414 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:16.080877 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:16.081309 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:16.211602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:16.218976 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-94ea28b6-ffcc-48e9-afe4-82b5b9d057b5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.151263 Aug 10 10:11:16.219554 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 480/949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:16 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:17.239897 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:17.240518 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:17.246843 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:17.247368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:17.247806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:17.248498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:17.248955 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:17.249379 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:17.381074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:17.388501 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3109484e-0cf9-4ec1-9037-0e2c408d8048 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.152534 Aug 10 10:11:17.389066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 470/950] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:17 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:18.409885 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:18.410538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:18.418218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:18.419151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:18.419946 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:18.421197 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:18.422022 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:18.422788 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:18.566526 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:18.574085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ac7b21fc-ba9d-4cff-88c2-293c286f68e5 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.168383 Aug 10 10:11:18.574646 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 481/951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:18 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:19.541817 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1777187541", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-329800085", "security_groups": [{"name": "tempest-secgroup-smoke-232252562"}], "block_device_mapping_v2": [{"uuid": "68f69f71-a923-4a17-8e9a-0e17a65548a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65312932-d264-4229-974f-272fdfb7e5f8"}]}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:19.596953 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:19.597811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:19.604868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:19.605386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:19.605927 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:19.606699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:19.607201 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:19.607764 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:19.670618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] validate_networks() for [('65312932-d264-4229-974f-272fdfb7e5f8', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:11:19.846016 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:19.854435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0c138841-4c37-4531-95cb-b44517dfe919 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.262579 Aug 10 10:11:19.855500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 482/952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:19 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:20.101713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:11:20.102177 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:11:20.102675 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:11:20.103163 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:11:20.103599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:11:20.112290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:20.112770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:20.113207 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:20.113941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:20.114399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:20.114828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:20.131497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:11:20.135414 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Getting quotas for user 7a9c654fc9bc4ad4b530d3f4df5c24c8 and project aa338ea60ddf4f53a71c19d51b21edb8. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:11:20.191272 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:11:20.193396 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68f69f71-a923-4a17-8e9a-0e17a65548a3',volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:11:20.322418 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cd0fa2a0-8a0f-421c-b26f-a38c3cd35d0b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.784420 Aug 10 10:11:20.323102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 471/953] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:11:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:11:20.334244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-bcaa9a80-dc51-464c-a371-febc938e24e4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:20.334855 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-bcaa9a80-dc51-464c-a371-febc938e24e4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:20.387534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-bcaa9a80-dc51-464c-a371-febc938e24e4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:20.394732 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-bcaa9a80-dc51-464c-a371-febc938e24e4 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1094 microversion: 2.1 time: 0.064834 Aug 10 10:11:20.395321 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 483/954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:20 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:20.876140 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:20.876758 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:20.882930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:20.883443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:20.883881 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:20.884577 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:20.885030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:20.885452 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:21.015242 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:21.022702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a0c4bccd-7325-4cab-ab50-a08b20b06cc9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.151369 Aug 10 10:11:21.023295 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 472/955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:20 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:21.416858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5ee807ef-3de4-46ca-b25f-0cd2645f67dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:21.417471 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5ee807ef-3de4-46ca-b25f-0cd2645f67dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:21.470107 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5ee807ef-3de4-46ca-b25f-0cd2645f67dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:21.476635 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5ee807ef-3de4-46ca-b25f-0cd2645f67dd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1094 microversion: 2.1 time: 0.065541 Aug 10 10:11:21.477239 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 484/956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:21 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:22.044228 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:22.044846 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:22.051478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:22.051961 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:22.052397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:22.053080 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:22.053535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:22.053962 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:22.184941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:22.192874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5c0672f8-0e1b-449b-8aeb-107eadb1e626 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.152458 Aug 10 10:11:22.193437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 473/957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:22 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:22.497378 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b1b013b9-3978-49d7-9c5c-c597519e1b1a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:22.497991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b1b013b9-3978-49d7-9c5c-c597519e1b1a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:22.551661 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-b1b013b9-3978-49d7-9c5c-c597519e1b1a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:22.558492 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b1b013b9-3978-49d7-9c5c-c597519e1b1a tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1094 microversion: 2.1 time: 0.064910 Aug 10 10:11:22.559075 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 485/958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:22 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:23.213641 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:23.214281 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:23.220567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:23.221052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:23.222011 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:23.222697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:23.223180 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:23.223607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:23.358522 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:23.366726 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-044b7b30-973d-41a5-b385-54e386915087 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.156932 Aug 10 10:11:23.367478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 474/959] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:23 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:23.579677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-88e988f7-1ad8-4e34-8765-e4e70f653223 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:23.580407 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-88e988f7-1ad8-4e34-8765-e4e70f653223 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:23.633886 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-88e988f7-1ad8-4e34-8765-e4e70f653223 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:23.640482 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-88e988f7-1ad8-4e34-8765-e4e70f653223 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1094 microversion: 2.1 time: 0.065005 Aug 10 10:11:23.641083 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 486/960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:23 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:24.388632 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:24.389368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:24.395998 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:24.396485 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:24.396929 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:24.397810 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:24.398420 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:24.399138 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:24.532965 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:24.540523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1e52bdd7-4cca-4c18-a6c3-5023eec4ee30 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.156078 Aug 10 10:11:24.541099 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 475/961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:24 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:24.661639 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:24.662365 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:24.669197 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:24.669696 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:24.670143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:24.670892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:24.671353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:24.671787 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:24.736465 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:24.746880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-97b84945-e7e0-4b98-8e16-ff9c64c1b4c5 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1144 microversion: 2.1 time: 0.089484 Aug 10 10:11:24.747510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 487/962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:24 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:25.561266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:25.561876 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:25.568826 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:25.569338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:25.569780 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:25.570472 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:25.570929 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:25.571381 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:25.698633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:25.707521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ade95c8a-d857-41a8-9daf-459041c61134 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.150135 Aug 10 10:11:25.708361 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 476/963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:25 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:25.767033 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:25.767684 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:25.774561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:25.775079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:25.775552 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:25.776229 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:25.776691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:25.777295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:25.839105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:25.846501 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0b5aa240-5844-4d4b-9be2-e7fc8daf6c5b tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1136 microversion: 2.1 time: 0.083406 Aug 10 10:11:25.847083 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 488/964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:25 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:26.730508 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:26.731008 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:26.737888 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:26.738388 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:26.738838 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:26.739608 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:26.740111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:26.740554 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:26.868288 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:26.869573 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:26.876798 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:26.877592 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:26.878150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:26.879097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:26.879768 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:26.880391 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:26.886659 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:26.895969 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9a1c0d8b-608a-456a-9a02-a8faac24c13b tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1570 microversion: 2.1 time: 0.169925 Aug 10 10:11:26.896553 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 477/965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:26 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:26.918216 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:26.918818 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:26.925211 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:26.925706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:26.926165 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:26.928699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:26.929372 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:26.929840 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:26.980296 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117896) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 10:11:27.007338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:27.019218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ad51abcc-73de-481f-a6e1-3ef7831cc066 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1210 microversion: 2.1 time: 0.154731 Aug 10 10:11:27.034827 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 489/966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:26 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1210 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:27.066196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-79191b15-4c4d-46f9-8865-25efe6a0d7cf tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "POST /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3/action" status: 202 len: 0 microversion: 2.1 time: 0.151237 Aug 10 10:11:27.070271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 478/967] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:11:26 2022] POST /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 10:11:27.077051 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:27.077536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:27.090878 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:27.091877 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:27.094207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:27.095228 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:27.097644 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:27.100048 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:27.345800 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:27.361062 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a87e8f48-cdca-4da0-809f-5f5c619e5aaa tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1518 microversion: 2.1 time: 0.289591 Aug 10 10:11:27.374477 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 490/968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:27 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:28.042699 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:28.043382 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:28.049512 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:28.050000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:28.050505 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:28.051234 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:28.052145 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:28.052692 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:28.121908 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-e6286fed-ee3d-415c-a848-a8c6c2047457 req-dd2cad61-e9d3-494c-817a-4eb1f89cdea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc4efdb-918a-4b72-8d53-cab4644a437e", "tag": "ce22d175-f01e-4f7c-b603-35e46036307e"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:28.135496 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e6286fed-ee3d-415c-a848-a8c6c2047457 req-dd2cad61-e9d3-494c-817a-4eb1f89cdea9 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:28.136206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e6286fed-ee3d-415c-a848-a8c6c2047457 req-dd2cad61-e9d3-494c-817a-4eb1f89cdea9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:28.136964 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e6286fed-ee3d-415c-a848-a8c6c2047457 req-dd2cad61-e9d3-494c-817a-4eb1f89cdea9 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:28.151876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-e6286fed-ee3d-415c-a848-a8c6c2047457 req-dd2cad61-e9d3-494c-817a-4eb1f89cdea9 service nova] Creating event network-changed:ce22d175-f01e-4f7c-b603-35e46036307e for instance efc4efdb-918a-4b72-8d53-cab4644a437e on hv-cinder-85083 Aug 10 10:11:28.168171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-e6286fed-ee3d-415c-a848-a8c6c2047457 req-dd2cad61-e9d3-494c-817a-4eb1f89cdea9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049900 Aug 10 10:11:28.169479 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 491/969] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:11:28.204478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:28.213322 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1919c62c-5d4d-4ebf-b7ed-f54f3fc003c0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.174769 Aug 10 10:11:28.214357 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 479/970] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:28 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:28.383244 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:28.384386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:28.390785 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:28.391185 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:28.391623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:28.392329 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:28.392788 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:28.393254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:28.527122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:28.535123 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9d4598a7-23c9-42cc-9df9-38dd26cda788 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.156189 Aug 10 10:11:28.535691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 492/971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:28 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:28.925994 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:28.928279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:28.934166 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:28.934651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:28.935121 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:28.935809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:28.936264 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:28.936688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:28.965242 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4e3bfb5b-cbd8-41e2-ba35-8d15a93318b9 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043787 Aug 10 10:11:28.965786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 480/972] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 10 10:11:28 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:29.028500 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:29.029394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:29.039435 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.040122 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.040575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.041289 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.041813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.042179 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.068753 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:11:29.149133 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9e2b652b-8905-4ff0-862e-2eb5cc5a481d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 204 len: 0 microversion: 2.20 time: 0.125130 Aug 10 10:11:29.150977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 493/973] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 10 10:11:29 2022] DELETE /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 10:11:29.159787 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:29.160482 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:29.166946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.167489 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.167930 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.168621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.169078 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.169505 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.235560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:29.236224 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:29.242079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.242568 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.243035 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.243733 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.244246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.244677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.331761 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:29.339677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:29.341173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:29.342431 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d2f9864b-b30a-4351-b325-3ef7cbf2ce7f tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.187174 Aug 10 10:11:29.342912 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 481/974] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:11:29 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 10:11:29.396841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:29.404380 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d02cb540-9de7-4d89-98f2-ff48a7aa8bec tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.173231 Aug 10 10:11:29.404975 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 494/975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:29 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:29.556830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:29.557445 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:29.563589 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.564074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.564509 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.565236 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.565688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.566308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.568047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-f71da0bf-b7ba-40e0-84e0-9d5f6ef9399c req-e3661b32-b55e-485b-bcfb-41a6aea7de38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb85e5e-fcd1-4e80-a2c3-10c3480645b3", "name": "network-vif-unplugged", "status": "completed", "tag": "5c6eec61-2bdf-470c-b2d4-6b8196c8bee9"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:29.571957 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:29.580389 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-f71da0bf-b7ba-40e0-84e0-9d5f6ef9399c req-e3661b32-b55e-485b-bcfb-41a6aea7de38 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:29.581397 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-f71da0bf-b7ba-40e0-84e0-9d5f6ef9399c req-e3661b32-b55e-485b-bcfb-41a6aea7de38 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:29.581834 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-f71da0bf-b7ba-40e0-84e0-9d5f6ef9399c req-e3661b32-b55e-485b-bcfb-41a6aea7de38 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:29.593507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-f71da0bf-b7ba-40e0-84e0-9d5f6ef9399c req-e3661b32-b55e-485b-bcfb-41a6aea7de38 service nova] Creating event network-vif-unplugged:5c6eec61-2bdf-470c-b2d4-6b8196c8bee9 for instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 on hv-cinder-85083 Aug 10 10:11:29.599148 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-f71da0bf-b7ba-40e0-84e0-9d5f6ef9399c req-e3661b32-b55e-485b-bcfb-41a6aea7de38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036230 Aug 10 10:11:29.600040 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 495/976] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:11:29.700834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:29.708835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9d5568e3-f049-4fab-9b5f-2e229cc74d56 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.155886 Aug 10 10:11:29.709433 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 482/977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:29 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:30.366454 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:30.367183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:30.373816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.374302 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.374738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.375463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.376186 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.376615 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.425763 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:30.427011 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:30.429024 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:30.429866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:30.436498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.436992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.437432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.438139 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.438596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.439049 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.553431 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:30.562325 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:30.563874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:30.565154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-54e58d20-8938-4d5b-afa4-f6938a862da0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1721 microversion: 2.20 time: 0.203022 Aug 10 10:11:30.565786 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 496/978] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:11:30 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:11:30.601571 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:30.609229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-30e157a4-a6ad-430f-948e-2d22ae25fa1f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.187367 Aug 10 10:11:30.609799 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 483/979] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:30 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:30.640318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:30.640829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:30.647406 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.647905 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.648354 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.649070 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.649534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.649976 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.729940 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:30.730088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lazy-loading 'services' on Instance uuid 984ac747-1c6d-40bf-8a41-b7873c68b603 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:11:30.730569 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:30.736691 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.737397 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.738023 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.738732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:30.739383 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:30.739820 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:30.811578 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-14541988-d30f-4c4c-8d28-bed753e28731 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-volume_attachments/80ab6323-ac26-4a3f-b85f-d18791dc0b50" status: 202 len: 0 microversion: 2.1 time: 0.174972 Aug 10 10:11:30.815486 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 497/980] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:11:30 2022] DELETE /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-volume_attachments/80ab6323-ac26-4a3f-b85f-d18791dc0b50 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:11:30.967353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:30.975238 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-4aac7987-6d7f-4979-86c3-69a1daadabab tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.249157 Aug 10 10:11:30.981250 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 484/981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:30 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:31.161529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:11:31.161798 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:11:31.589692 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:31.590420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:31.597966 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:31.598544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:31.599020 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:31.600095 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:31.600650 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:31.601093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:31.621430 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:31.630289 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:31.631697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:31.638853 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:31.639645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:31.640261 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:31.640979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:31.641443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:31.641874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:31.847547 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:31.856354 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:31.858001 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ef546ba84fa46d581ed6c82ec302e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20760466eac94b87b14c279bba223b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:31.859344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ad69bed5-7aa7-4222-a4e7-91417672bd97 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 200 len: 1653 microversion: 2.20 time: 0.274267 Aug 10 10:11:31.859967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 498/982] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:11:31 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 1653 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 10:11:31.972679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c42de49e-6b8b-41e1-a2bb-976512f1c675 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:31.978614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42de49e-6b8b-41e1-a2bb-976512f1c675 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:31.979374 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42de49e-6b8b-41e1-a2bb-976512f1c675 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:31.979814 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c42de49e-6b8b-41e1-a2bb-976512f1c675 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.003851 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c42de49e-6b8b-41e1-a2bb-976512f1c675 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Going to try to stop instance {{(pid=117895) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 10:11:32.021463 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:32.029485 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-58574435-24fc-4210-a442-17ac5611d63e tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.403565 Aug 10 10:11:32.030519 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 485/983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:31 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:32.036173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:32.037272 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:32.043500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:32.044231 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:32.044768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.045611 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:32.046200 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:32.046795 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.052449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c42de49e-6b8b-41e1-a2bb-976512f1c675 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action" status: 202 len: 0 microversion: 2.1 time: 0.082990 Aug 10 10:11:32.052903 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 499/984] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:11:31 2022] POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 10:11:32.069780 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:32.071322 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:32.078299 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:32.079079 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:32.079706 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.080822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:32.081674 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:32.082481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.298500 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:32.305088 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:32.308007 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e8dae60b-c7f7-4792-90e4-650b6dd4fba0 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.276109 Aug 10 10:11:32.310271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 486/985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:32 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:32.313623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-668a0194-1e8f-4ee0-b7aa-9d445ecb4477 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1678 microversion: 2.1 time: 0.249608 Aug 10 10:11:32.328722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-af74f305-a6ad-430b-98e9-ab60c19fe228 req-8c28555a-c7a3-45fd-934f-49e8ecb6cc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57896e7-150e-441c-a4ae-9c9f7d91227a", "name": "network-vif-deleted", "tag": "5096bd70-a7a2-459b-b55a-d5cca428c770"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:32.332002 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-af74f305-a6ad-430b-98e9-ab60c19fe228 req-8c28555a-c7a3-45fd-934f-49e8ecb6cc80 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:32.332747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-af74f305-a6ad-430b-98e9-ab60c19fe228 req-8c28555a-c7a3-45fd-934f-49e8ecb6cc80 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:32.333748 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-af74f305-a6ad-430b-98e9-ab60c19fe228 req-8c28555a-c7a3-45fd-934f-49e8ecb6cc80 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.335202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 500/986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:32 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1678 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:32.347113 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-af74f305-a6ad-430b-98e9-ab60c19fe228 req-8c28555a-c7a3-45fd-934f-49e8ecb6cc80 service nova] Creating event network-vif-deleted:5096bd70-a7a2-459b-b55a-d5cca428c770 for instance b57896e7-150e-441c-a4ae-9c9f7d91227a on hv-cinder-85083 Aug 10 10:11:32.352173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-af74f305-a6ad-430b-98e9-ab60c19fe228 req-8c28555a-c7a3-45fd-934f-49e8ecb6cc80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040171 Aug 10 10:11:32.355569 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 487/987] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:11:32.885313 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:32.886013 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:32.892776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:32.893755 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:32.894194 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.894907 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:32.895481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:32.895913 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:32.910192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] HTTP exception thrown: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Request method failure captured: Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a HTTP/1.1 Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84LCoL0LIvMFQCBFcB9DVAh_6HkdUyhF_Pluf8gBUZR09NN_3XIqd3dqY9jE_-vtvAU8v5FO5JHhWVeg8aNDG_QiYcSUCNFgLmFKzAf80e6-vYGYWa4nXeVTjHveaFbnqCWolXtKjRGUUJuPmzZXxWvrPbCq6HxNYiRpq3nEU-w3oJ0 Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:11:32.911958 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20760466eac94b87b14c279bba223b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20760466eac94b87b14c279bba223b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}] Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2ef546ba84fa46d581ed6c82ec302e7d Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:32.913691 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'b57896e7-150e-441c-a4ae-9c9f7d91227a'} Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:11:32.916246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:32.917742 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:32.919160 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Returning 404 to user: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:11:32.919160 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-fd461944-3ca8-4140-9159-e34f0bc0f43e tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 404 len: 111 microversion: 2.20 time: 0.032127 Aug 10 10:11:32.919160 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 501/988] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:11:32 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:11:32.923217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cfc0e2f1-e0fb-447b-923a-f1bb4923c4b0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '.version_select at 0x7f22fbfa0790>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:32.943446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cfc0e2f1-e0fb-447b-923a-f1bb4923c4b0 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679105724" status: 204 len: 0 microversion: 2.20 time: 0.024426 Aug 10 10:11:32.944051 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 488/989] 10.222.0.20 () {60 vars in 1259 bytes} [Wed Aug 10 10:11:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679105724 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 10:11:33.050832 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:33.051531 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:33.057497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:33.058000 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:33.058456 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:33.059184 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:33.059826 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:33.060451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:33.224418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:33.235383 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1ce52891-30e7-42de-98b8-8d5b216522a2 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.188876 Aug 10 10:11:33.239923 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 502/990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:33 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:33.328977 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:33.329712 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:33.336523 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:33.336816 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:33.337010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:33.337575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:33.337693 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:33.338326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:33.338781 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:33.339254 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:33.344804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:33.344804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:33.344804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:33.345156 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:33.345603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:33.346047 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:33.545856 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:33.549806 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:33.554276 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f8c5803d-7642-49f0-ab61-d7ac7210737d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.229170 Aug 10 10:11:33.560167 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-e352b020-5a49-4da5-8e14-6c5a58cab9ea tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1678 microversion: 2.1 time: 0.227897 Aug 10 10:11:33.560829 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 503/991] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:33 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:33.573978 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 489/992] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:33 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:34.257054 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:34.257575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:34.259514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=8 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:34.265382 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.265868 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.266307 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.267032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.267616 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.268670 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.397882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:34.405444 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-de3288c0-4571-4062-b473-f3eafbd16519 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.152388 Aug 10 10:11:34.406024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 504/993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:34 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:34.575631 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:34.576310 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:34.581257 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:34.581877 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:34.582778 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.583307 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.583768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.584452 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.584913 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.585347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.587709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.588202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.588646 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.589347 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.589809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.590245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.778931 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:34.787174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6f5e9bb9-11e7-4c9d-ba8e-3afd37910f7e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1678 microversion: 2.1 time: 0.209717 Aug 10 10:11:34.787744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 505/994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:34 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:11:34.788096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:34.792187 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:34.792680 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:34.795991 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ff5eca83-8b51-46e2-bf75-09f299c06361 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.224176 Aug 10 10:11:34.796565 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 490/995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:34 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:34.801488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.801488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.801488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.801488 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.801872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.801872 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.815813 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] HTTP exception thrown: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Request method failure captured: Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a HTTP/1.1 Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84LCoL0LIvMFQCBFcB9DVAh_6HkdUyhF_Pluf8gBUZR09NN_3XIqd3dqY9jE_-vtvAU8v5FO5JHhWVeg8aNDG_QiYcSUCNFgLmFKzAf80e6-vYGYWa4nXeVTjHveaFbnqCWolXtKjRGUUJuPmzZXxWvrPbCq6HxNYiRpq3nEU-w3oJ0 Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:11:34.817376 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20760466eac94b87b14c279bba223b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20760466eac94b87b14c279bba223b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}] Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2ef546ba84fa46d581ed6c82ec302e7d Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.819097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'b57896e7-150e-441c-a4ae-9c9f7d91227a'} Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:11:34.820012 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.821528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.823024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Returning 404 to user: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:11:34.823024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-eac224f7-be69-46eb-8d62-4730e40bf39d tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 404 len: 111 microversion: 2.20 time: 0.030078 Aug 10 10:11:34.823024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 506/996] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 10 10:11:34 2022] DELETE /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:11:34.827274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:34.827931 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: b57896e7-150e-441c-a4ae-9c9f7d91227a] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:34.834199 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.834688 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.835240 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.835936 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:34.836399 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:34.836835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:34.850253 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] HTTP exception thrown: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Request method failure captured: Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a HTTP/1.1 Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84LCoL0LIvMFQCBFcB9DVAh_6HkdUyhF_Pluf8gBUZR09NN_3XIqd3dqY9jE_-vtvAU8v5FO5JHhWVeg8aNDG_QiYcSUCNFgLmFKzAf80e6-vYGYWa4nXeVTjHveaFbnqCWolXtKjRGUUJuPmzZXxWvrPbCq6HxNYiRpq3nEU-w3oJ0 Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:11:34.851923 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20760466eac94b87b14c279bba223b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20760466eac94b87b14c279bba223b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}] Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 2ef546ba84fa46d581ed6c82ec302e7d Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.853526 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'b57896e7-150e-441c-a4ae-9c9f7d91227a'} Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:11:34.854468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. Aug 10 10:11:34.855963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:34.857279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Returning 404 to user: Instance b57896e7-150e-441c-a4ae-9c9f7d91227a could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:11:34.857279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d8511b97-a83e-40db-b4ab-d3674a317022 tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a" status: 404 len: 111 microversion: 2.20 time: 0.029929 Aug 10 10:11:34.857279 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 491/997] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:11:34 2022] GET /compute/v2.1/servers/b57896e7-150e-441c-a4ae-9c9f7d91227a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 10:11:35.427281 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:35.427892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:35.434197 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:35.434681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:35.435164 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:35.435856 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:35.436314 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:35.436743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:35.564969 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:35.572439 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6bdd44f9-b5ca-4da5-95d9-4aeb765ebf42 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.149713 Aug 10 10:11:35.572998 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 507/998] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:35 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:35.808574 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:35.809222 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:35.815536 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:35.815707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:35.816111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:35.816219 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:35.816551 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:35.817243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:35.817695 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:35.818125 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:35.821977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:35.822464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:35.822908 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:35.823647 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:35.824189 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:35.824622 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:36.011257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:36.015819 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:36.018735 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9b13a4fc-0cb5-439b-97f3-0793a744fba4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1678 microversion: 2.1 time: 0.214043 Aug 10 10:11:36.019338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 492/999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:35 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:36.026448 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:36.026448 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:36.026677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5a4b5d37-5410-4353-87a3-1eeabf778ab9 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.212875 Aug 10 10:11:36.026677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 508/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:35 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:36.030235 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:36.030672 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:36.031144 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:36.031837 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:36.032291 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:36.032717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:36.046146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] HTTP exception thrown: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Request method failure captured: Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: DELETE /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 HTTP/1.1 Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84LCoL0LIvMFQCBFcB9DVAh_6HkdUyhF_Pluf8gBUZR09NN_3XIqd3dqY9jE_-vtvAU8v5FO5JHhWVeg8aNDG_QiYcSUCNFgLmFKzAf80e6-vYGYWa4nXeVTjHveaFbnqCWolXtKjRGUUJuPmzZXxWvrPbCq6HxNYiRpq3nEU-w3oJ0 Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:11:36.047760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20760466eac94b87b14c279bba223b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20760466eac94b87b14c279bba223b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}] Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 2ef546ba84fa46d581ed6c82ec302e7d Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.049979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9'} Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:11:36.050874 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.052359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.053732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Returning 404 to user: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:11:36.053732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5d254b6f-2d0c-439d-aa2b-112d3a5134cd tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 404 len: 111 microversion: 2.20 time: 0.028880 Aug 10 10:11:36.053732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 493/1001] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 10 10:11:36 2022] DELETE /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:11:36.058206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:36.058821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] [instance: bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:36.064697 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:36.065183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:36.065627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:36.066356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:36.066818 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:36.067282 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:36.080525 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] HTTP exception thrown: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Request method failure captured: Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 HTTP/1.1 Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84LCoL0LIvMFQCBFcB9DVAh_6HkdUyhF_Pluf8gBUZR09NN_3XIqd3dqY9jE_-vtvAU8v5FO5JHhWVeg8aNDG_QiYcSUCNFgLmFKzAf80e6-vYGYWa4nXeVTjHveaFbnqCWolXtKjRGUUJuPmzZXxWvrPbCq6HxNYiRpq3nEU-w3oJ0 Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:11:36.082093 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/20760466eac94b87b14c279bba223b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_20760466eac94b87b14c279bba223b2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/20760466eac94b87b14c279bba223b2d"}]}] Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 20760466eac94b87b14c279bba223b2d Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607414450 Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 2ef546ba84fa46d581ed6c82ec302e7d Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607414450-project Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.083825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9'} Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:11:36.084681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. Aug 10 10:11:36.086114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:11:36.087495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] Returning 404 to user: Instance bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:11:36.087495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ece0cefd-6d6d-473a-b4f8-0ad805075eef tempest-AttachVolumeShelveTestJSON-607414450 tempest-AttachVolumeShelveTestJSON-607414450-project] 10.222.0.20 "GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9" status: 404 len: 111 microversion: 2.20 time: 0.029142 Aug 10 10:11:36.087495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 509/1002] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 10 10:11:36 2022] GET /compute/v2.1/servers/bd51d3d7-bb1d-4d97-9aaa-59b2353bd1d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 10:11:36.593533 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:36.594089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:36.600100 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:36.600582 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:36.601025 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:36.601718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:36.602175 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:36.602603 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:36.737266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:36.744789 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8a1726bf-307d-4bfd-b90c-956eb917e1aa tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.155162 Aug 10 10:11:36.745438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 494/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:36 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:37.040232 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:37.040916 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:37.046332 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:37.047588 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:37.047721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:37.048913 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:37.050395 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:37.051519 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:37.051991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:37.052788 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:37.066212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:37.067266 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:37.067895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:37.068798 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:37.069506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:37.069946 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:37.288548 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:37.293013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:37.296981 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-37e3b740-9478-40ff-857a-070d93829c32 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1678 microversion: 2.1 time: 0.260617 Aug 10 10:11:37.297871 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 510/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:37 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:37.312241 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e0ff700c-f7ac-4007-aaa9-6e595cce143a tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.268718 Aug 10 10:11:37.313204 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 495/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:37 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:37.766740 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:37.769256 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:37.787145 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:37.787660 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:37.788106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:37.789014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:37.789562 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:37.790001 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:37.935510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:37.947560 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-20c19052-e37c-4c1f-8b28-175cf8785d86 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.185603 Aug 10 10:11:37.948438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 511/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:37 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:38.323583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:38.324334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:38.334135 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:38.335577 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:38.343864 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.351627 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.352311 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.352860 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.354820 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.355633 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.356415 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.357218 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.357778 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.358335 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.359134 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.359463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.583295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:38.588243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:38.591363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ab64304a-3080-4a9b-a2f0-f69215a70138 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1576 microversion: 2.1 time: 0.261532 Aug 10 10:11:38.592192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 512/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:38 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1576 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:38.597577 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-44beece5-6c3c-4828-bf1a-6e83ee403d0b tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1655 microversion: 2.1 time: 0.283026 Aug 10 10:11:38.598268 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 496/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:38 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1655 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:38.618613 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b194155b-761a-4212-a066-894e4d227f5f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:38.625249 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b194155b-761a-4212-a066-894e4d227f5f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.626002 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b194155b-761a-4212-a066-894e4d227f5f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.626449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-b194155b-761a-4212-a066-894e4d227f5f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.649919 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-b194155b-761a-4212-a066-894e4d227f5f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Going to try to start instance {{(pid=117895) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 10:11:38.699913 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b194155b-761a-4212-a066-894e4d227f5f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action" status: 202 len: 0 microversion: 2.1 time: 0.084990 Aug 10 10:11:38.701363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 513/1009] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 10 10:11:38 2022] POST /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:11:38.709563 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:38.711001 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:38.716768 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.717206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.717637 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.718338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.718800 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.719257 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.907648 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:38.917728 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-31e27871-f3f4-4893-8e8d-ab4d46854fe5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1664 microversion: 2.1 time: 0.212362 Aug 10 10:11:38.918791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 497/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:38 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:38.919090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:11:38.919526 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:11:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:11:38.972171 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:38.973339 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:38.985555 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.986208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.988967 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:38.990700 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:38.991538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:38.992758 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:39.269403 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:39.280775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-881dba28-d552-4140-90dd-73eab3c4b041 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.314948 Aug 10 10:11:39.281538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 514/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:38 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:39.613297 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:39.613992 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:39.625181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:39.626164 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:39.626791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:39.628286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:39.629051 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:39.629656 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:39.811079 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:39.819080 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c22a917b-e113-40b9-9f75-4bcd4e885971 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1563 microversion: 2.1 time: 0.210092 Aug 10 10:11:39.820045 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 498/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:39 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1563 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:39.878593 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-69ab29e8-10af-48bb-9edc-a2d64b035924 req-1d3c2d1e-bbf0-4735-9afc-fb7b908f0754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc4efdb-918a-4b72-8d53-cab4644a437e", "name": "network-vif-plugged", "status": "completed", "tag": "ce22d175-f01e-4f7c-b603-35e46036307e"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:39.892711 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-69ab29e8-10af-48bb-9edc-a2d64b035924 req-1d3c2d1e-bbf0-4735-9afc-fb7b908f0754 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:39.893466 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-69ab29e8-10af-48bb-9edc-a2d64b035924 req-1d3c2d1e-bbf0-4735-9afc-fb7b908f0754 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:39.894437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-69ab29e8-10af-48bb-9edc-a2d64b035924 req-1d3c2d1e-bbf0-4735-9afc-fb7b908f0754 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:39.899618 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:39.910415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-69ab29e8-10af-48bb-9edc-a2d64b035924 req-1d3c2d1e-bbf0-4735-9afc-fb7b908f0754 service nova] Creating event network-vif-plugged:ce22d175-f01e-4f7c-b603-35e46036307e for instance efc4efdb-918a-4b72-8d53-cab4644a437e on hv-cinder-85083 Aug 10 10:11:39.915633 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-69ab29e8-10af-48bb-9edc-a2d64b035924 req-1d3c2d1e-bbf0-4735-9afc-fb7b908f0754 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041382 Aug 10 10:11:39.916619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 515/1013] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:11:39.942348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:39.945035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:39.953654 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:39.954376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:39.963890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:39.964731 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:39.968904 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:39.969552 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:40.122561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:40.131730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-49d8eee7-b09d-49f6-8144-3dcf8a568bcd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1664 microversion: 2.1 time: 0.194322 Aug 10 10:11:40.148272 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 499/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:39 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1664 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:40.303127 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:40.303830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:40.311046 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:40.311575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:40.311971 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:40.312641 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:40.313144 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:40.313522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:40.475189 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:40.501412 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-9df2c9cc-ced5-44c8-9914-5cd4575bddef tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.202429 Aug 10 10:11:40.513261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 516/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:40 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:41.157747 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:41.158293 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:41.165422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:41.165909 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:41.166342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:41.167066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:41.167527 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:41.167952 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:41.302756 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:41.310240 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-5453c8ce-6537-4a3b-81d8-cbe85332b857 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1668 microversion: 2.1 time: 0.156951 Aug 10 10:11:41.310808 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 500/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:41 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:41.527557 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:41.527557 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:41.532707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:41.533206 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:41.533656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:41.534370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:41.534839 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:41.535304 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:41.714459 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:41.722290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-57823091-5239-4e46-b888-10c29d944e51 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1265 microversion: 2.1 time: 0.200768 Aug 10 10:11:41.723743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 517/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:41 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:41.942802 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-3129014e-b08a-4c7d-885b-3b06b1e5059a req-1d37c80a-9f23-4594-a295-1d4234b5e107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb85e5e-fcd1-4e80-a2c3-10c3480645b3", "name": "network-vif-plugged", "status": "completed", "tag": "5c6eec61-2bdf-470c-b2d4-6b8196c8bee9"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:41.956273 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3129014e-b08a-4c7d-885b-3b06b1e5059a req-1d37c80a-9f23-4594-a295-1d4234b5e107 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:41.956760 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3129014e-b08a-4c7d-885b-3b06b1e5059a req-1d37c80a-9f23-4594-a295-1d4234b5e107 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:41.957206 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3129014e-b08a-4c7d-885b-3b06b1e5059a req-1d37c80a-9f23-4594-a295-1d4234b5e107 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:41.968838 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-3129014e-b08a-4c7d-885b-3b06b1e5059a req-1d37c80a-9f23-4594-a295-1d4234b5e107 service nova] Creating event network-vif-plugged:5c6eec61-2bdf-470c-b2d4-6b8196c8bee9 for instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 on hv-cinder-85083 Aug 10 10:11:41.973759 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-3129014e-b08a-4c7d-885b-3b06b1e5059a req-1d37c80a-9f23-4594-a295-1d4234b5e107 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035871 Aug 10 10:11:41.974359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 501/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:11:42.743650 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:42.744277 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:42.750932 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:42.751463 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:42.752553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:42.753579 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:42.754272 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:42.754897 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:42.894129 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:42.902707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-8b4f2308-d78c-42f1-a787-dd4eaca9dbdd tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1453 microversion: 2.1 time: 0.162463 Aug 10 10:11:42.903709 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 518/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:42 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:42.924736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:11:42.925438 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:11:42.932486 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:42.932979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:42.933419 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:42.934117 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:42.934578 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:42.935035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:42.958782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=100 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:43.077427 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:11:43.085411 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3fd730bd-7ee4-4a44-be9e-f7a864665c2c tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1453 microversion: 2.1 time: 0.165387 Aug 10 10:11:43.086013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 502/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:11:42 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:11:44.739978 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-d448d025-9e13-4022-87b4-d10511ea8f8f req-f40d4dc0-4eda-4e4d-b850-49d69e7e5443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc4efdb-918a-4b72-8d53-cab4644a437e", "tag": "ce22d175-f01e-4f7c-b603-35e46036307e"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:11:44.746597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:44.755497 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-d448d025-9e13-4022-87b4-d10511ea8f8f req-f40d4dc0-4eda-4e4d-b850-49d69e7e5443 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:11:44.756055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-d448d025-9e13-4022-87b4-d10511ea8f8f req-f40d4dc0-4eda-4e4d-b850-49d69e7e5443 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:11:44.756553 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-d448d025-9e13-4022-87b4-d10511ea8f8f req-f40d4dc0-4eda-4e4d-b850-49d69e7e5443 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:11:44.769342 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-d448d025-9e13-4022-87b4-d10511ea8f8f req-f40d4dc0-4eda-4e4d-b850-49d69e7e5443 service nova] Creating event network-changed:ce22d175-f01e-4f7c-b603-35e46036307e for instance efc4efdb-918a-4b72-8d53-cab4644a437e on hv-cinder-85083 Aug 10 10:11:44.774353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-d448d025-9e13-4022-87b4-d10511ea8f8f req-f40d4dc0-4eda-4e4d-b850-49d69e7e5443 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038612 Aug 10 10:11:44.775089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 519/1021] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:12:05.682443 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1095069126", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:05.689806 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:05.690665 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:05.739528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] validate_networks() for None {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:12:06.003171 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:12:06.003602 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:12:06.004080 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:12:06.004496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:12:06.004912 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:12:06.013561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:06.014042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:06.014480 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:06.015245 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:06.015707 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:06.016141 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:06.033677 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Getting quotas for project 1fc4b8f7573d4c13a122c9a32ed71403. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:12:06.037730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Getting quotas for user e13b0d8cddd3413c8af575c061671515 and project 1fc4b8f7573d4c13a122c9a32ed71403. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:12:06.048413 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:12:06.050605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:12:06.093860 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9d6d9c51-c547-41a7-85ed-80ae8801ee0b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415284 Aug 10 10:12:06.094496 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 503/1022] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 10:12:06.103351 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=20 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:06.106232 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:06.112009 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a1653e4f-ba28-43db-86e4-21b26b48154d tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:06.112712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a1653e4f-ba28-43db-86e4-21b26b48154d tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:06.167715 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a1653e4f-ba28-43db-86e4-21b26b48154d tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:06.175799 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a1653e4f-ba28-43db-86e4-21b26b48154d tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1215 microversion: 2.1 time: 0.074177 Aug 10 10:12:06.176479 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 520/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:06 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:07.198942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:07.199740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:07.206196 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:07.206792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:07.207333 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:07.208111 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:07.208647 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:07.209158 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:07.300439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:07.308003 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-23567acb-9c9f-41de-a857-f3ce7ed3b3e8 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1273 microversion: 2.1 time: 0.114438 Aug 10 10:12:07.308583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 504/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:07 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:08.330523 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:08.331736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:08.338041 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:08.338538 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:08.338993 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:08.339699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:08.340166 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:08.340600 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:08.531619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:08.539659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-35e6dd6d-357d-47a8-8754-94746699c18a tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1315 microversion: 2.1 time: 0.213978 Aug 10 10:12:08.540449 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 521/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:08 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:08.768659 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-3cbdc038-d628-4cce-8603-def873e657b1 req-12c1d32d-ca0f-437d-aa7c-f00be7c6539c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f816a7d3-1140-4596-a93f-8329471a6e08", "tag": "d481eec0-075e-442e-9d36-9b11d3054cbf"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:08.790528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3cbdc038-d628-4cce-8603-def873e657b1 req-12c1d32d-ca0f-437d-aa7c-f00be7c6539c service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:08.791562 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3cbdc038-d628-4cce-8603-def873e657b1 req-12c1d32d-ca0f-437d-aa7c-f00be7c6539c service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:08.792014 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-3cbdc038-d628-4cce-8603-def873e657b1 req-12c1d32d-ca0f-437d-aa7c-f00be7c6539c service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:08.804706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-3cbdc038-d628-4cce-8603-def873e657b1 req-12c1d32d-ca0f-437d-aa7c-f00be7c6539c service nova] Creating event network-changed:d481eec0-075e-442e-9d36-9b11d3054cbf for instance f816a7d3-1140-4596-a93f-8329471a6e08 on hv-cinder-85083 Aug 10 10:12:08.812612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-3cbdc038-d628-4cce-8603-def873e657b1 req-12c1d32d-ca0f-437d-aa7c-f00be7c6539c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047310 Aug 10 10:12:08.812835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 505/1026] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:12:09.560411 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:09.561032 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:09.567727 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:09.568214 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:09.568656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:09.569353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:09.569815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:09.570249 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:09.701858 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:09.709834 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-a64fab11-3167-410b-9aeb-4752e926aabc tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1315 microversion: 2.1 time: 0.153327 Aug 10 10:12:09.710402 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 522/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:09 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:10.730638 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:10.731322 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:10.738069 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:10.738558 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:10.739034 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:10.739730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:10.740191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:10.740621 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:10.869214 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:10.877491 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f9544e79-7130-419e-99ef-47e3e882f847 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1315 microversion: 2.1 time: 0.151555 Aug 10 10:12:10.878060 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 506/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:10 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:11.897919 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:11.898540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:11.904870 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:11.905363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:11.905804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:11.906506 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:11.906984 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:11.907933 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:12.035152 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:12.042479 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5df63573-621e-481f-b89c-9f684cd004f1 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1315 microversion: 2.1 time: 0.148539 Aug 10 10:12:12.043055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 523/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:11 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:13.064620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:13.065239 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:13.071649 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:13.072146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:13.072588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:13.073284 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:13.073744 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:13.074176 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:13.206341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:13.214137 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8601046e-42fe-4ac4-8e32-dc4b1dc22013 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1315 microversion: 2.1 time: 0.154042 Aug 10 10:12:13.214702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 507/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:13 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:13.808238 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-6b1256ce-88b0-4713-87c3-e7242dac4b43 req-5f74f70b-6955-4b5c-8568-62b46b016f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816a7d3-1140-4596-a93f-8329471a6e08", "name": "network-vif-plugged", "status": "completed", "tag": "d481eec0-075e-442e-9d36-9b11d3054cbf"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:13.819185 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-6b1256ce-88b0-4713-87c3-e7242dac4b43 req-5f74f70b-6955-4b5c-8568-62b46b016f0a service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:13.819681 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-6b1256ce-88b0-4713-87c3-e7242dac4b43 req-5f74f70b-6955-4b5c-8568-62b46b016f0a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:13.820125 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-6b1256ce-88b0-4713-87c3-e7242dac4b43 req-5f74f70b-6955-4b5c-8568-62b46b016f0a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:13.832010 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-6b1256ce-88b0-4713-87c3-e7242dac4b43 req-5f74f70b-6955-4b5c-8568-62b46b016f0a service nova] Creating event network-vif-plugged:d481eec0-075e-442e-9d36-9b11d3054cbf for instance f816a7d3-1140-4596-a93f-8329471a6e08 on hv-cinder-85083 Aug 10 10:12:13.837434 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-6b1256ce-88b0-4713-87c3-e7242dac4b43 req-5f74f70b-6955-4b5c-8568-62b46b016f0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Aug 10 10:12:13.838024 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 524/1031] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:12:14.234286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:14.234883 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:14.242089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:14.242578 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:14.243042 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:14.243734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:14.244190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:14.244616 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:14.373475 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:14.381567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3fe16e9f-5578-4f10-9aa0-860f0201c487 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1315 microversion: 2.1 time: 0.151138 Aug 10 10:12:14.382131 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 508/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:14 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:15.402481 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:15.403202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:15.409777 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:15.410264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:15.410707 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:15.411426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:15.411880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:15.412667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:15.539293 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:15.546747 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-34d3026e-80c9-45c1-b918-a13879b605ea tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1315 microversion: 2.1 time: 0.148517 Aug 10 10:12:15.547339 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 525/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:15 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:16.568222 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:16.568861 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:16.571263 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:16.571916 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:16.577388 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.577869 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.578303 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.579013 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.580102 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.580531 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.715181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:16.722735 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-ddab161b-acdb-4d85-8e03-10ae98927d30 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1465 microversion: 2.1 time: 0.158311 Aug 10 10:12:16.723345 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 509/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:16 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:16.769855 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:16.770368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:16.770485 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:16.772399 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:16.772695 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:16.778061 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.778554 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.778689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.779015 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.779188 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.779633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.779738 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.780161 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.780335 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.780591 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.780791 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.781220 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.805544 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:12:16.809895 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-098342cd-80fc-43ad-a17c-e107ac1dfed1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043857 Aug 10 10:12:16.810465 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 510/1035] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:12:16 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:12:16.872362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:16.872866 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:16.880006 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.880208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.880633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.881338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.881800 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.882611 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.887572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f158615f-4ccc-4a51-89f9-339d86ce4a31 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 204 len: 0 microversion: 2.1 time: 0.121729 Aug 10 10:12:16.888515 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 526/1036] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:12:16 2022] DELETE /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 10:12:16.897057 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:16.897761 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:16.903516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.904003 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.904436 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.905159 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.905650 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.906076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:16.908645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:12:16.982244 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-dcac2acc-469b-4d45-9942-217353238b11 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 204 len: 0 microversion: 2.1 time: 0.113490 Aug 10 10:12:16.982935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 511/1037] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:12:16 2022] DELETE /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 10:12:16.992034 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:16.992786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:16.998541 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:16.999052 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:16.999498 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:17.000189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:17.001000 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:17.001942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:17.040464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:17.049050 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d258a87e-c5c7-4d48-ad7f-e3b9f415f250 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1471 microversion: 2.1 time: 0.156254 Aug 10 10:12:17.049664 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 527/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:16 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:17.134689 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:17.142125 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-98aa7315-7042-4e36-ae98-9b6afd418146 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1674 microversion: 2.1 time: 0.154216 Aug 10 10:12:17.142686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 512/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:16 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:12:18.070208 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:18.070863 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:18.077655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:18.078155 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:18.078603 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:18.079338 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:18.079804 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:18.080238 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:18.163722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:18.164341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:18.170979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:18.171473 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:18.171914 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:18.172617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:18.173651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:18.174090 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:18.221297 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:18.228821 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-88f79b27-3cbb-4973-959d-2fa861c9d935 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1471 microversion: 2.1 time: 0.162667 Aug 10 10:12:18.229394 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 528/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:18 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:18.307347 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:18.315439 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-59e7cc73-9fe6-466d-a5f9-b822af0887cc tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1674 microversion: 2.1 time: 0.155585 Aug 10 10:12:18.316021 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 513/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:18 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:12:19.250678 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:19.251833 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:19.258619 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:19.259152 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:19.259608 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:19.260310 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:19.260775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:19.261210 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:19.337323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:19.337941 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:19.344359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:19.344898 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:19.345343 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:19.346035 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:19.346497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:19.346925 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:19.404447 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:19.413420 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5b8a2a1f-4258-4c15-9999-8c562dcaf834 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1471 microversion: 2.1 time: 0.166601 Aug 10 10:12:19.413659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 529/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:19 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:19.485326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:19.493292 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-43c40b55-d332-468a-b6a9-41449dfb0f76 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1674 microversion: 2.1 time: 0.159925 Aug 10 10:12:19.493886 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 514/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:19 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:12:20.434437 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:20.435221 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:20.442074 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:20.442646 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:20.443179 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:20.443950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:20.444498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:20.445005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:20.515010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:20.515624 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:20.522600 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:20.523116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:20.523557 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:20.524250 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:20.524706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:20.525155 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:20.720266 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13b0d8cddd3413c8af575c061671515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fc4b8f7573d4c13a122c9a32ed71403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:20.728717 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-62835915-acbe-4213-a46f-31af6ba47579 tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 200 len: 1471 microversion: 2.1 time: 0.298878 Aug 10 10:12:20.729440 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 530/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:20 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 1471 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:20.786462 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:20.794995 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6e5e2c85-156a-4018-8371-d9c17c3b5944 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1674 microversion: 2.1 time: 0.283793 Aug 10 10:12:20.795680 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 515/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:20 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1674 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:12:20.970446 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-8c7a81c1-3014-4fc6-b41e-c4886ed15c3b req-a90fa748-8a6f-4bfc-a4de-a4110f23a7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f816a7d3-1140-4596-a93f-8329471a6e08", "name": "network-vif-deleted", "tag": "d481eec0-075e-442e-9d36-9b11d3054cbf"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:20.982881 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-8c7a81c1-3014-4fc6-b41e-c4886ed15c3b req-a90fa748-8a6f-4bfc-a4de-a4110f23a7da service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:20.983413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-8c7a81c1-3014-4fc6-b41e-c4886ed15c3b req-a90fa748-8a6f-4bfc-a4de-a4110f23a7da service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:20.983853 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-8c7a81c1-3014-4fc6-b41e-c4886ed15c3b req-a90fa748-8a6f-4bfc-a4de-a4110f23a7da service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:20.996850 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-8c7a81c1-3014-4fc6-b41e-c4886ed15c3b req-a90fa748-8a6f-4bfc-a4de-a4110f23a7da service nova] Creating event network-vif-deleted:d481eec0-075e-442e-9d36-9b11d3054cbf for instance f816a7d3-1140-4596-a93f-8329471a6e08 on hv-cinder-85083 Aug 10 10:12:21.003572 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-8c7a81c1-3014-4fc6-b41e-c4886ed15c3b req-a90fa748-8a6f-4bfc-a4de-a4110f23a7da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036699 Aug 10 10:12:21.004744 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 531/1046] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:12:21.432243 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-1b645c7b-9c0e-4146-a01b-2bb8dfb73818 req-001dd939-d3b9-4266-88f8-faa6be47510b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "984ac747-1c6d-40bf-8a41-b7873c68b603", "name": "network-vif-deleted", "tag": "e5df3a48-fb99-4636-80fa-43c28a7e64cb"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:21.445765 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1b645c7b-9c0e-4146-a01b-2bb8dfb73818 req-001dd939-d3b9-4266-88f8-faa6be47510b service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:21.446258 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1b645c7b-9c0e-4146-a01b-2bb8dfb73818 req-001dd939-d3b9-4266-88f8-faa6be47510b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:21.446694 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1b645c7b-9c0e-4146-a01b-2bb8dfb73818 req-001dd939-d3b9-4266-88f8-faa6be47510b service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:21.464031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-1b645c7b-9c0e-4146-a01b-2bb8dfb73818 req-001dd939-d3b9-4266-88f8-faa6be47510b service nova] Creating event network-vif-deleted:e5df3a48-fb99-4636-80fa-43c28a7e64cb for instance 984ac747-1c6d-40bf-8a41-b7873c68b603 on hv-cinder-85083 Aug 10 10:12:21.469337 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-1b645c7b-9c0e-4146-a01b-2bb8dfb73818 req-001dd939-d3b9-4266-88f8-faa6be47510b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040686 Aug 10 10:12:21.469976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 516/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:12:21.751493 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:21.752246 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] [instance: f816a7d3-1140-4596-a93f-8329471a6e08] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:21.758422 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:21.759034 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:21.759542 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:21.760303 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:21.760880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:21.761374 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:21.774877 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] HTTP exception thrown: Instance f816a7d3-1140-4596-a93f-8329471a6e08 could not be found. Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Request method failure captured: Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 HTTP/1.1 Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84R0rj0fTjP5n9JAJG6NWTaAcRX-RyvJ9oMzJc-1JZT53hoFtEclzxvhcG_E14XTuHiifAOX0-vXgf_Xze8Z-B2_UCMM5plqzSvYDpMWSklyvbeJeW8e7aZFZ7ltxpEba3MNlzyjQUemWA6wVrENsBXfNOvbvzI1alBQLWUp55FyhQg Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: 1fc4b8f7573d4c13a122c9a32ed71403 Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-VolumesNegativeTest-239958652 Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:12:21.776676 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1fc4b8f7573d4c13a122c9a32ed71403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fc4b8f7573d4c13a122c9a32ed71403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1fc4b8f7573d4c13a122c9a32ed71403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1fc4b8f7573d4c13a122c9a32ed71403"}]}] Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-VolumesNegativeTest-239958652 Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: 1fc4b8f7573d4c13a122c9a32ed71403 Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-VolumesNegativeTest-239958652 Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-VolumesNegativeTest-239958652-project Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: e13b0d8cddd3413c8af575c061671515 Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-VolumesNegativeTest-239958652-project Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance f816a7d3-1140-4596-a93f-8329471a6e08 could not be found. Aug 10 10:12:21.778401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': 'f816a7d3-1140-4596-a93f-8329471a6e08'} Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f816a7d3-1140-4596-a93f-8329471a6e08 could not be found. Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:12:21.779387 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f816a7d3-1140-4596-a93f-8329471a6e08 could not be found. Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f816a7d3-1140-4596-a93f-8329471a6e08 could not be found. Aug 10 10:12:21.780685 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:21.781830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] Returning 404 to user: Instance f816a7d3-1140-4596-a93f-8329471a6e08 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:12:21.781830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3f65f9a3-d6fe-45c6-b912-430215e2f80b tempest-VolumesNegativeTest-239958652 tempest-VolumesNegativeTest-239958652-project] 10.222.0.20 "GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08" status: 404 len: 111 microversion: 2.1 time: 0.032163 Aug 10 10:12:21.781830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 532/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:21 2022] GET /compute/v2.1/servers/f816a7d3-1140-4596-a93f-8329471a6e08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:12:21.818650 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:21.819583 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:21.826884 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:21.827506 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:21.828010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:21.839338 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:21.840094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:21.840544 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:21.873034 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:21.874311 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:21.875341 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:21.876683 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.objects.instance [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lazy-loading 'fault' on Instance uuid 984ac747-1c6d-40bf-8a41-b7873c68b603 {{(pid=117896) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:12:21.929858 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:21.939164 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-330f5fb3-9cab-4598-9d8a-3e8b6d1508c2 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 200 len: 1328 microversion: 2.1 time: 0.125466 Aug 10 10:12:21.940497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 517/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:21 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 1328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:22.960344 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:22.961090 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:22.967604 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:22.968163 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:22.968675 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:22.969368 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:22.969822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:22.970249 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:22.983265 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] HTTP exception thrown: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Request method failure captured: Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 HTTP/1.1 Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84O-rjX4Bc9oU_jreV1jnpCe_V9e-rM-h1caJKpbQknaUWpktRel5N8_mBvsto-l-wZ2q5a51lX8it2VAFglxEo1S0lsSV9hInXBhvKJMbM-Nsvmr0eArGEX95oGz3IiYn6_Mns6VYbQrADsNlBqREQMfXKTrT6dKvuxKhao0jm5qus Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:12:22.984802 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}] Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 67a34ddb337649ee948d319b0bf5fab3 Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:12:22.987105 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '984ac747-1c6d-40bf-8a41-b7873c68b603'} Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:12:22.988900 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:12:22.990640 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:12:22.992096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Returning 404 to user: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:12:22.992096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-189de97c-eeaf-48fc-95ba-cf997f0b7682 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 404 len: 111 microversion: 2.1 time: 0.030274 Aug 10 10:12:22.992096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 533/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:22 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:12:22.997320 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-fc132bea-dd85-427f-9361-6ba0de33d1c6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '.version_select at 0x7f22fbfc9af0>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:23.021248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-fc132bea-dd85-427f-9361-6ba0de33d1c6 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965846176" status: 202 len: 0 microversion: 2.1 time: 0.027603 Aug 10 10:12:23.021852 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 518/1051] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 10 10:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965846176 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:12:23.935930 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-b9553339-5c68-42d3-a055-88b814645b97 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'create', calling method: .version_select at 0x7f22fbdfcf70>, body: {"keypair": {"name": "tempest-keypair-1655395363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRm5VDgGQNM1g/CBiWfWM/OXIaPLNIiWTeI9/jm8I8BVry5o6wHG1lpfPfFRBI0654ipbLkxFWtW9qjiO+/mott00IQNaXdSyUZ6u2p7nL98UHmtX540tOc0Q01JxCphA=="}} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:23.951569 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-b9553339-5c68-42d3-a055-88b814645b97 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:12:23.956005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.quota [None req-b9553339-5c68-42d3-a055-88b814645b97 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for user 67a34ddb337649ee948d319b0bf5fab3 and project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'key_pairs'} {{(pid=117895) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:12:23.980669 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-b9553339-5c68-42d3-a055-88b814645b97 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049031 Aug 10 10:12:23.981337 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 534/1052] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 10 10:12:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:12:25.275485 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-506065451", "imageRef": "60b2851e-cc1b-4510-8221-3e8428d4e15f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d5abfff-bcea-4881-a2ae-753e70ad39a2"}], "security_groups": [{"name": "tempest-securitygroup--299414224"}], "key_name": "tempest-keypair-1655395363", "user_data": "}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:25.376509 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.network.neutron [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] validate_networks() for [('5d5abfff-bcea-4881-a2ae-753e70ad39a2', None, None, None, None, None)] {{(pid=117896) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 10:12:25.739596 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Flavor limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 10:12:25.740055 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Image limits 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 10:12:25.740756 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Flavor pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 10:12:25.741182 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Image pref 0:0:0 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 10:12:25.741605 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.virt.hardware [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117896) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 10:12:25.751409 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:25.752053 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:25.752501 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:25.753247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:25.753714 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:25.754148 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:25.771193 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 10:12:25.776116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.quota [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Getting quotas for user 67a34ddb337649ee948d319b0bf5fab3 and project d006aeb4f532425ab423537ebcb2f0b1. Resources: {'cores', 'ram', 'instances'} {{(pid=117896) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 10:12:25.789066 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Going to run 1 instances... {{(pid=117896) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 10:12:25.791380 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60b2851e-cc1b-4510-8221-3e8428d4e15f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117896) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 10:12:25.840323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-323c657c-3c6d-4b1d-9574-42b88c5b385d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.569597 Aug 10 10:12:25.840986 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 519/1053] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 10 10:12:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 10:12:25.852654 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-62d89d5d-84ea-44c2-bac8-3d34267a0283 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:25.853522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-62d89d5d-84ea-44c2-bac8-3d34267a0283 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:25.915252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-62d89d5d-84ea-44c2-bac8-3d34267a0283 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:25.922327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-62d89d5d-84ea-44c2-bac8-3d34267a0283 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1237 microversion: 2.1 time: 0.074243 Aug 10 10:12:25.923671 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 535/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:25 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:26.946465 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:26.947176 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:26.959782 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:26.960396 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:26.960918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:26.961706 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:26.962179 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:26.962617 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:27.025695 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:27.033991 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-1ad2f2a5-4a12-4c83-a767-ad477a080683 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1295 microversion: 2.1 time: 0.093579 Aug 10 10:12:27.034758 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 520/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:26 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:28.055332 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:28.055952 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:28.062356 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:28.063059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:28.063510 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:28.064213 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:28.064672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:28.065097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:28.163827 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-35502ff1-7f1d-43a2-b110-02d431be40c1 req-ed54caf5-3b9e-4c32-9a85-ea0f49eb4195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f3c2bc-d770-4ef4-9b0b-10927a406d62", "tag": "ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:28.188966 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-35502ff1-7f1d-43a2-b110-02d431be40c1 req-ed54caf5-3b9e-4c32-9a85-ea0f49eb4195 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:28.190928 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-35502ff1-7f1d-43a2-b110-02d431be40c1 req-ed54caf5-3b9e-4c32-9a85-ea0f49eb4195 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:28.191616 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-35502ff1-7f1d-43a2-b110-02d431be40c1 req-ed54caf5-3b9e-4c32-9a85-ea0f49eb4195 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:28.196023 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:28.205779 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-35502ff1-7f1d-43a2-b110-02d431be40c1 req-ed54caf5-3b9e-4c32-9a85-ea0f49eb4195 service nova] Creating event network-changed:ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8 for instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 on hv-cinder-85083 Aug 10 10:12:28.211092 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-35502ff1-7f1d-43a2-b110-02d431be40c1 req-ed54caf5-3b9e-4c32-9a85-ea0f49eb4195 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053945 Aug 10 10:12:28.212094 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 521/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:12:28.213106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:28.221396 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0e8de087-1f7d-48b3-9106-551f2f8c3c69 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.170059 Aug 10 10:12:28.222282 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 536/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:28 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:29.243288 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:29.243987 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:29.250359 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:29.251612 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:29.252050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:29.252740 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:29.253202 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:29.253635 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:29.379039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:29.386348 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-2d1712ec-eb5c-4206-b0ce-b23f40a721c5 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.148393 Aug 10 10:12:29.386920 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 522/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:29 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:30.407803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:30.408415 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:30.414770 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:30.415295 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:30.415736 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:30.416426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:30.416882 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:30.417306 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:30.544202 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:30.552261 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-3e07136d-f341-439f-91a2-de13c7dbe0b3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.148332 Aug 10 10:12:30.552825 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 537/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:30 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:31.573391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:31.574010 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:31.580535 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:31.581018 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:31.581461 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:31.582157 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:31.582620 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:31.583088 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:31.713323 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:31.721212 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d41230f8-84a1-46a0-93b5-62afc5e6eebd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.151762 Aug 10 10:12:31.721788 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 523/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:31 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:32.741990 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:32.742616 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:32.749165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:32.749659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:32.750096 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:32.751686 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:32.752151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:32.752580 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:32.886757 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:32.894192 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-788a1298-57ca-401e-8f1d-d36ee933b7e1 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.156145 Aug 10 10:12:32.894762 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 538/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:32 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:33.914792 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:33.915436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:33.921901 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:33.923015 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:33.923464 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:33.924154 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:33.924619 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:33.925073 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:34.065716 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:34.073208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9f6575f0-360e-4101-b4a5-a0495adbf530 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.162257 Aug 10 10:12:34.073721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 524/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:33 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 10:12:35.092987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:35.093602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:35.100632 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:35.101119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:35.101561 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:35.102258 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:35.102726 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:35.103185 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:35.229266 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:35.236683 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ff2a2902-9415-4dd8-b3d8-075fd052d4a4 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.147560 Aug 10 10:12:35.237257 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 539/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:35 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:36.257484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:36.258101 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:36.260521 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:36.261194 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell0:SELECT=6 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:36.262104 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:36.269645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:36.270142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:36.270590 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:36.271316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:36.271841 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:36.272382 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:36.404960 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:36.413146 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-07222de0-594a-4bcc-a921-7cb499e59e06 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.159458 Aug 10 10:12:36.413702 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 525/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:36 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:37.433589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:37.434209 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:37.436207 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell0:SELECT=6 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:37.437353 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:37.443980 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:37.444469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:37.444947 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:37.445656 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:37.446109 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:37.446540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:37.450927 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:37.578469 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:37.586516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-ad124b51-1a96-43bd-9239-85840f6d21bf tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.156837 Aug 10 10:12:37.587165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 540/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:37 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:38.606588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:38.607181 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:38.613735 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:38.614217 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:38.614650 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:38.615368 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:38.615824 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:38.616248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:38.740511 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:38.747772 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8a29e92f-71a2-4e2e-9bf1-ac7c0cc1b315 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.145103 Aug 10 10:12:38.748334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 526/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:38 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:39.065912 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-e3511175-1d13-43fe-97e9-c9d3e9541a92 req-9e2272a3-f2ab-4930-9aa2-63c9378f7a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f3c2bc-d770-4ef4-9b0b-10927a406d62", "name": "network-vif-plugged", "status": "completed", "tag": "ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:39.076282 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e3511175-1d13-43fe-97e9-c9d3e9541a92 req-9e2272a3-f2ab-4930-9aa2-63c9378f7a9a service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:39.076775 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e3511175-1d13-43fe-97e9-c9d3e9541a92 req-9e2272a3-f2ab-4930-9aa2-63c9378f7a9a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:39.077243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-e3511175-1d13-43fe-97e9-c9d3e9541a92 req-9e2272a3-f2ab-4930-9aa2-63c9378f7a9a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:39.088348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-e3511175-1d13-43fe-97e9-c9d3e9541a92 req-9e2272a3-f2ab-4930-9aa2-63c9378f7a9a service nova] Creating event network-vif-plugged:ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8 for instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 on hv-cinder-85083 Aug 10 10:12:39.093290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-e3511175-1d13-43fe-97e9-c9d3e9541a92 req-9e2272a3-f2ab-4930-9aa2-63c9378f7a9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031335 Aug 10 10:12:39.094534 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 541/1067] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:12:39.769719 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:39.770254 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:39.776663 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:39.777173 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:39.777613 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:39.778298 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:39.778753 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:39.779208 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:39.916645 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:39.926109 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d67e472e-6b71-494e-86dd-69e3e774e140 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.160943 Aug 10 10:12:39.926686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 527/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:39 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:40.947624 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:40.948339 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:40.955159 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:40.955663 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:40.956114 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:40.957272 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:40.957781 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:40.958227 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:41.092723 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:41.101106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1510db3b-1f9a-4e24-82aa-8aa554de73d3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1362 microversion: 2.1 time: 0.158168 Aug 10 10:12:41.101708 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 542/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:40 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:42.123561 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:42.124437 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:42.131892 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:42.132387 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:42.132839 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:42.133539 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:42.134004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:42.134441 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:42.262868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:12:42.270926 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-85f83d82-cba0-4e7d-ab9b-fc5e5f912116 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1547 microversion: 2.1 time: 0.152372 Aug 10 10:12:42.271522 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 528/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:12:42 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:12:42.292361 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:12:42.292892 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:12:42.299721 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:42.300211 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:42.300651 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:42.301348 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:42.301809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:42.302241 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:42.377426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-68b8332a-67ef-4221-bf0c-48634936e242 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088977 Aug 10 10:12:42.378011 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 543/1071] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 10 10:12:42 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:12:43.534432 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-1a7fc8b8-fe36-4995-9f5d-ecb2d5f23e67 req-a59b9406-0850-44fb-bf25-6436c8dcb85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f3c2bc-d770-4ef4-9b0b-10927a406d62", "tag": "ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:12:43.544446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1a7fc8b8-fe36-4995-9f5d-ecb2d5f23e67 req-a59b9406-0850-44fb-bf25-6436c8dcb85a service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:12:43.544904 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1a7fc8b8-fe36-4995-9f5d-ecb2d5f23e67 req-a59b9406-0850-44fb-bf25-6436c8dcb85a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:12:43.545334 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-1a7fc8b8-fe36-4995-9f5d-ecb2d5f23e67 req-a59b9406-0850-44fb-bf25-6436c8dcb85a service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:12:43.556780 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-1a7fc8b8-fe36-4995-9f5d-ecb2d5f23e67 req-a59b9406-0850-44fb-bf25-6436c8dcb85a service nova] Creating event network-changed:ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8 for instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 on hv-cinder-85083 Aug 10 10:12:43.562449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-1a7fc8b8-fe36-4995-9f5d-ecb2d5f23e67 req-a59b9406-0850-44fb-bf25-6436c8dcb85a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031936 Aug 10 10:12:43.563905 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 529/1072] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:13:00.059220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=7 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:00.060015 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=17 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:00.066269 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=9 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:00.067316 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=44 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:00.067803 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:00.068403 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:00.071664 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-83b54b05-1004-4941-93bc-b06f8c01c261 req-fc7f5ac0-dec5-493f-98e1-7601bf0c4554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb85e5e-fcd1-4e80-a2c3-10c3480645b3", "tag": "5c6eec61-2bdf-470c-b2d4-6b8196c8bee9"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:00.075881 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:00.076393 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:00.076846 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:00.077564 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:00.078029 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:00.078464 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:00.084589 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-83b54b05-1004-4941-93bc-b06f8c01c261 req-fc7f5ac0-dec5-493f-98e1-7601bf0c4554 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:00.085076 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-83b54b05-1004-4941-93bc-b06f8c01c261 req-fc7f5ac0-dec5-493f-98e1-7601bf0c4554 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:00.085515 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-83b54b05-1004-4941-93bc-b06f8c01c261 req-fc7f5ac0-dec5-493f-98e1-7601bf0c4554 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:00.097065 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-83b54b05-1004-4941-93bc-b06f8c01c261 req-fc7f5ac0-dec5-493f-98e1-7601bf0c4554 service nova] Creating event network-changed:5c6eec61-2bdf-470c-b2d4-6b8196c8bee9 for instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 on hv-cinder-85083 Aug 10 10:13:00.102592 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-83b54b05-1004-4941-93bc-b06f8c01c261 req-fc7f5ac0-dec5-493f-98e1-7601bf0c4554 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038101 Aug 10 10:13:00.103416 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 530/1073] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:00.105457 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Going to try to terminate instance {{(pid=117895) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:13:00.194077 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d2bf2238-35f9-4a27-944c-eb304a3a8b51 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 204 len: 0 microversion: 2.1 time: 0.136237 Aug 10 10:13:00.195196 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 544/1074] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:13:00 2022] DELETE /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:13:00.203489 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:00.204293 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:00.211436 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:00.211918 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:00.212355 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:00.213059 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:00.213509 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:00.213935 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:00.355255 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:00.363486 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-551c5620-35de-4ecb-a26c-321619602045 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.164147 Aug 10 10:13:00.364274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 531/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:00 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:01.394659 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:01.395472 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:01.401885 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:01.402369 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:01.402810 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:01.403528 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:01.403983 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:01.404405 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:01.541293 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:01.548743 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5a948414-0d73-4b1f-8b13-7c42102bcb09 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1569 microversion: 2.1 time: 0.158960 Aug 10 10:13:01.549507 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 545/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:01 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:02.264969 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-452628a3-f9dd-4609-a578-d8ed5f71069d req-35ea5676-1e2f-4f9b-ba38-51422f10c4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb85e5e-fcd1-4e80-a2c3-10c3480645b3", "name": "network-vif-deleted", "tag": "5c6eec61-2bdf-470c-b2d4-6b8196c8bee9"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:02.278459 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-452628a3-f9dd-4609-a578-d8ed5f71069d req-35ea5676-1e2f-4f9b-ba38-51422f10c4b7 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:02.278979 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-452628a3-f9dd-4609-a578-d8ed5f71069d req-35ea5676-1e2f-4f9b-ba38-51422f10c4b7 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:02.279413 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-452628a3-f9dd-4609-a578-d8ed5f71069d req-35ea5676-1e2f-4f9b-ba38-51422f10c4b7 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:02.292599 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-452628a3-f9dd-4609-a578-d8ed5f71069d req-35ea5676-1e2f-4f9b-ba38-51422f10c4b7 service nova] Creating event network-vif-deleted:5c6eec61-2bdf-470c-b2d4-6b8196c8bee9 for instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 on hv-cinder-85083 Aug 10 10:13:02.297309 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-452628a3-f9dd-4609-a578-d8ed5f71069d req-35ea5676-1e2f-4f9b-ba38-51422f10c4b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036050 Aug 10 10:13:02.298096 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 532/1077] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:02.570343 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:02.571005 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:02.577629 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:02.578168 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:02.578645 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:02.580217 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:02.580778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:02.581195 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:02.834830 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26782775a52b48e9a9a84d64d28ceca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdaf00b54b894a9db2de21ff1ef475a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:02.842243 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-32e11aa4-892b-4921-81d1-ca344aa8a55c tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 200 len: 1219 microversion: 2.1 time: 0.276424 Aug 10 10:13:02.842805 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 546/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:02 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 1219 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:03.864038 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:03.864730 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] [instance: 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:03.871241 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:03.871717 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:03.872149 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:03.872832 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:03.873286 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:03.873742 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:03.887344 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] HTTP exception thrown: Instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 could not be found. Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Request method failure captured: Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 HTTP/1.1 Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84OYnfBT5HIq-9QEubGjyHRvN1yxM54LAv1ZP2Z-bOjwRIATKBf6Bi7_x3SojbZUlT19FRsCOkbY9hFF3Yrc8QPw97gUOxZpdSSPlu8JKNs1K9W-vdxrEe6VhD8-CKhFTnl5o0mNCGhMTtOJwTJk_8ZQI5lplxAdwmEQzufIsIUTto8 Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: cdaf00b54b894a9db2de21ff1ef475a2 Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestShelveInstance-2041335079 Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:13:03.889404 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cdaf00b54b894a9db2de21ff1ef475a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cdaf00b54b894a9db2de21ff1ef475a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cdaf00b54b894a9db2de21ff1ef475a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cdaf00b54b894a9db2de21ff1ef475a2"}]}] Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestShelveInstance-2041335079 Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: cdaf00b54b894a9db2de21ff1ef475a2 Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestShelveInstance-2041335079 Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-TestShelveInstance-2041335079-project Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 26782775a52b48e9a9a84d64d28ceca0 Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestShelveInstance-2041335079-project Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 could not be found. Aug 10 10:13:03.891247 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '4fb85e5e-fcd1-4e80-a2c3-10c3480645b3'} Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 could not be found. Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:03.892927 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 could not be found. Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 could not be found. Aug 10 10:13:03.894492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:03.895891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Returning 404 to user: Instance 4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:03.895891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-e62f191a-cf06-4d03-9d88-952437ac0b34 tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3" status: 404 len: 111 microversion: 2.1 time: 0.031001 Aug 10 10:13:03.895891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 533/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:03 2022] GET /compute/v2.1/servers/4fb85e5e-fcd1-4e80-a2c3-10c3480645b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:04.046366 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-871d41e5-66a4-4604-acb9-3f9ce22c060d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] Calling method '.version_select at 0x7f23081db8b0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:04.068628 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-871d41e5-66a4-4604-acb9-3f9ce22c060d tempest-TestShelveInstance-2041335079 tempest-TestShelveInstance-2041335079-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1577537931" status: 202 len: 0 microversion: 2.1 time: 0.025908 Aug 10 10:13:04.069064 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 547/1080] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Aug 10 10:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1577537931 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:13:13.469124 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:13.469633 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:13.475418 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:13.476446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:13.477089 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:13.477835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:13.478824 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:13.479375 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:13.480039 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:13.480648 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-5f0ef99a-462a-41b3-ba7b-953fb58180ad req-48e9c086-fb03-40b6-9340-1c848179c0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc4efdb-918a-4b72-8d53-cab4644a437e", "tag": "ce22d175-f01e-4f7c-b603-35e46036307e"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:13.491174 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-5f0ef99a-462a-41b3-ba7b-953fb58180ad req-48e9c086-fb03-40b6-9340-1c848179c0dd service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:13.491658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-5f0ef99a-462a-41b3-ba7b-953fb58180ad req-48e9c086-fb03-40b6-9340-1c848179c0dd service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:13.492084 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-5f0ef99a-462a-41b3-ba7b-953fb58180ad req-48e9c086-fb03-40b6-9340-1c848179c0dd service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:13.504874 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-5f0ef99a-462a-41b3-ba7b-953fb58180ad req-48e9c086-fb03-40b6-9340-1c848179c0dd service nova] Creating event network-changed:ce22d175-f01e-4f7c-b603-35e46036307e for instance efc4efdb-918a-4b72-8d53-cab4644a437e on hv-cinder-85083 Aug 10 10:13:13.507674 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:13:13.510778 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-5f0ef99a-462a-41b3-ba7b-953fb58180ad req-48e9c086-fb03-40b6-9340-1c848179c0dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036428 Aug 10 10:13:13.511915 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 548/1081] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:13.589957 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-727cdfe5-5351-40e1-925a-0a59af512045 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 204 len: 0 microversion: 2.1 time: 0.124487 Aug 10 10:13:13.594894 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 534/1082] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:13:13 2022] DELETE /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:13:13.602071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:13.603183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:13.610352 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:13.611254 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:13.611889 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:13.612823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:13.613346 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:13.613996 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:14.030760 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:14.038236 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-289e5865-36bc-4f74-b5a6-d7ef54be548f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1578 microversion: 2.1 time: 0.441526 Aug 10 10:13:14.038805 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 549/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:13 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1578 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:15.062528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:15.063513 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:15.070388 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:15.070882 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:15.071361 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:15.072067 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:15.072529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:15.072958 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:15.513981 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:15.521837 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-9072d681-87bf-4be8-8a38-89ffcbec9133 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 200 len: 1578 microversion: 2.1 time: 0.464673 Aug 10 10:13:15.522434 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 535/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:15 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 1578 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:15.766323 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-6f722cf6-0131-4c21-8681-d13efe7e9cc7 req-9b6d2b56-cb97-4339-9290-718880452990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc4efdb-918a-4b72-8d53-cab4644a437e", "name": "network-vif-deleted", "tag": "ce22d175-f01e-4f7c-b603-35e46036307e"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:15.776760 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-6f722cf6-0131-4c21-8681-d13efe7e9cc7 req-9b6d2b56-cb97-4339-9290-718880452990 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:15.777247 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-6f722cf6-0131-4c21-8681-d13efe7e9cc7 req-9b6d2b56-cb97-4339-9290-718880452990 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:15.777679 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-6f722cf6-0131-4c21-8681-d13efe7e9cc7 req-9b6d2b56-cb97-4339-9290-718880452990 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:15.790123 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-6f722cf6-0131-4c21-8681-d13efe7e9cc7 req-9b6d2b56-cb97-4339-9290-718880452990 service nova] Creating event network-vif-deleted:ce22d175-f01e-4f7c-b603-35e46036307e for instance efc4efdb-918a-4b72-8d53-cab4644a437e on hv-cinder-85083 Aug 10 10:13:15.795660 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-6f722cf6-0131-4c21-8681-d13efe7e9cc7 req-9b6d2b56-cb97-4339-9290-718880452990 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Aug 10 10:13:15.796269 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 550/1085] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:16.543030 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:16.543651 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: efc4efdb-918a-4b72-8d53-cab4644a437e] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:16.550773 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:16.551299 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:16.551771 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:16.552497 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:16.552963 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:16.553423 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:16.566446 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] HTTP exception thrown: Instance efc4efdb-918a-4b72-8d53-cab4644a437e could not be found. Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Request method failure captured: Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e HTTP/1.1 Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84MHGXWcO6js7q284IDmaN9I2THAWFpaQ0BFBqiZLoVPIzggtRSi2qXmMKgmSWFTVbRHrorw6-XFB1kLcwFVDnZ76RIhDO5e91X8A3egWudQiARnJfZh8oAT_5IbqI7UiKyyKZyvT__wrphq_wUYvR74Wkxc-sQRNjvnFxs52QF-N3I Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:13:16.568189 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}] Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 7a9c654fc9bc4ad4b530d3f4df5c24c8 Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance efc4efdb-918a-4b72-8d53-cab4644a437e could not be found. Aug 10 10:13:16.569697 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'efc4efdb-918a-4b72-8d53-cab4644a437e'} Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc4efdb-918a-4b72-8d53-cab4644a437e could not be found. Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:16.570529 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc4efdb-918a-4b72-8d53-cab4644a437e could not be found. Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc4efdb-918a-4b72-8d53-cab4644a437e could not be found. Aug 10 10:13:16.572190 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:16.573885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Returning 404 to user: Instance efc4efdb-918a-4b72-8d53-cab4644a437e could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:16.573885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3875777b-7e3d-44cc-9674-1a836c6ae957 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e" status: 404 len: 111 microversion: 2.1 time: 0.030402 Aug 10 10:13:16.573885 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 536/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:16 2022] GET /compute/v2.1/servers/efc4efdb-918a-4b72-8d53-cab4644a437e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:18.817495 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:18.818242 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:18.824413 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:18.824917 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:18.825355 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:18.826060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:18.826522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:18.826976 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:18.850614 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-13d0bcc9-2602-4994-b12d-70b1250dba4d tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/ips" status: 200 len: 144 microversion: 2.1 time: 0.038109 Aug 10 10:13:18.851227 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 551/1087] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 10 10:13:18 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:19.660201 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:19.660720 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [req-804fcf35-04f4-4ec0-8657-81c426b04de1 req-abcb54db-ec9d-465f-992a-a92a5f9cbdc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db7f1046-d973-491b-823c-2f174d6a3c23", "tag": "81662ae7-c0b0-499e-851f-61aeef6c8739"}]} {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:19.660853 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:19.674525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:19.674938 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:19.675406 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:19.676172 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:19.676637 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:19.677064 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:19.680522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-804fcf35-04f4-4ec0-8657-81c426b04de1 req-abcb54db-ec9d-465f-992a-a92a5f9cbdc1 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:19.681300 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-804fcf35-04f4-4ec0-8657-81c426b04de1 req-abcb54db-ec9d-465f-992a-a92a5f9cbdc1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:19.681973 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [req-804fcf35-04f4-4ec0-8657-81c426b04de1 req-abcb54db-ec9d-465f-992a-a92a5f9cbdc1 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:19.694330 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.compute.server_external_events [req-804fcf35-04f4-4ec0-8657-81c426b04de1 req-abcb54db-ec9d-465f-992a-a92a5f9cbdc1 service nova] Creating event network-changed:81662ae7-c0b0-499e-851f-61aeef6c8739 for instance db7f1046-d973-491b-823c-2f174d6a3c23 on hv-cinder-85083 Aug 10 10:13:19.701074 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [req-804fcf35-04f4-4ec0-8657-81c426b04de1 req-abcb54db-ec9d-465f-992a-a92a5f9cbdc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044132 Aug 10 10:13:19.701945 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 552/1088] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:13:19.708560 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:13:19.803956 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-cb599744-a366-4087-8032-3c634816d0f0 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 204 len: 0 microversion: 2.1 time: 0.147427 Aug 10 10:13:19.805058 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 537/1089] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:13:19 2022] DELETE /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:13:19.813983 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:19.815290 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:19.822060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:19.823326 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:19.824014 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:19.824748 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:19.825220 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:19.825655 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:19.980053 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:19.988183 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4ce7493a-b898-4756-8bb1-0f06421a68ea tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1576 microversion: 2.1 time: 0.178461 Aug 10 10:13:19.988941 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 553/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:19 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:20.186097 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63747d60-a856-482e-8007-1b1cfc23f2a9"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:20.188680 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:20.194567 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:20.195174 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:20.195713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:20.196492 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:20.197023 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:20.197525 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:20.956478 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-61b95770-2ef4-4597-a8d9-906929cb529a tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774810 Aug 10 10:13:20.957121 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 538/1091] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:13:20 2022] POST /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments => generated 194 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:21.009612 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:21.010904 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:21.019274 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:21.019987 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:21.020602 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:21.021522 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:21.022364 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:21.023222 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:21.207234 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:21.214941 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-d9928ef9-8a27-492c-900a-92e0ce801a60 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1576 microversion: 2.1 time: 0.209016 Aug 10 10:13:21.223089 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 554/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:21 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:21.720248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-76799f85-0fa1-4904-8511-38d77670b4bf req-811db246-1312-426b-bf63-35a7cebab446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db7f1046-d973-491b-823c-2f174d6a3c23", "name": "network-vif-deleted", "tag": "81662ae7-c0b0-499e-851f-61aeef6c8739"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:21.731118 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-76799f85-0fa1-4904-8511-38d77670b4bf req-811db246-1312-426b-bf63-35a7cebab446 service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:21.731607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-76799f85-0fa1-4904-8511-38d77670b4bf req-811db246-1312-426b-bf63-35a7cebab446 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:21.733087 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-76799f85-0fa1-4904-8511-38d77670b4bf req-811db246-1312-426b-bf63-35a7cebab446 service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:21.745879 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-76799f85-0fa1-4904-8511-38d77670b4bf req-811db246-1312-426b-bf63-35a7cebab446 service nova] Creating event network-vif-deleted:81662ae7-c0b0-499e-851f-61aeef6c8739 for instance db7f1046-d973-491b-823c-2f174d6a3c23 on hv-cinder-85083 Aug 10 10:13:21.750607 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-76799f85-0fa1-4904-8511-38d77670b4bf req-811db246-1312-426b-bf63-35a7cebab446 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036582 Aug 10 10:13:21.751685 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 539/1093] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:22.236836 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:22.237363 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:22.244499 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:22.244995 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:22.245438 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:22.246139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:22.246620 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:22.247056 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:22.279718 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:22.280318 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:22.280991 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:22.281548 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lazy-loading 'fault' on Instance uuid db7f1046-d973-491b-823c-2f174d6a3c23 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:13:22.323227 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a9c654fc9bc4ad4b530d3f4df5c24c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa338ea60ddf4f53a71c19d51b21edb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:22.333231 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5b4ca5bb-13b5-46f4-b8af-48c934a50e4f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 200 len: 1183 microversion: 2.1 time: 0.099870 Aug 10 10:13:22.333809 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 555/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:22 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 1183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:23.354912 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:23.355552 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: db7f1046-d973-491b-823c-2f174d6a3c23] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:23.362854 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:23.363362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:23.363799 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:23.364484 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:23.364942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:23.365369 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:23.378718 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] HTTP exception thrown: Instance db7f1046-d973-491b-823c-2f174d6a3c23 could not be found. Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Request method failure captured: Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 HTTP/1.1 Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84MHGXWcO6js7q284IDmaN9I2THAWFpaQ0BFBqiZLoVPIzggtRSi2qXmMKgmSWFTVbRHrorw6-XFB1kLcwFVDnZ76RIhDO5e91X8A3egWudQiARnJfZh8oAT_5IbqI7UiKyyKZyvT__wrphq_wUYvR74Wkxc-sQRNjvnFxs52QF-N3I Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:13:23.380340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}] Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 7a9c654fc9bc4ad4b530d3f4df5c24c8 Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance db7f1046-d973-491b-823c-2f174d6a3c23 could not be found. Aug 10 10:13:23.381821 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': 'db7f1046-d973-491b-823c-2f174d6a3c23'} Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db7f1046-d973-491b-823c-2f174d6a3c23 could not be found. Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:23.382588 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db7f1046-d973-491b-823c-2f174d6a3c23 could not be found. Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db7f1046-d973-491b-823c-2f174d6a3c23 could not be found. Aug 10 10:13:23.384191 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.385807 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Returning 404 to user: Instance db7f1046-d973-491b-823c-2f174d6a3c23 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:23.385807 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-8e8605d4-c1ad-49a6-859a-ab337771512f tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23" status: 404 len: 111 microversion: 2.1 time: 0.031102 Aug 10 10:13:23.385807 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 540/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:23 2022] GET /compute/v2.1/servers/db7f1046-d973-491b-823c-2f174d6a3c23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:23.813901 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:23.814432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:23.820950 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:23.821447 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:23.821894 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:23.822589 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:23.823080 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:23.823516 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:23.836789 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] HTTP exception thrown: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Request method failure captured: Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 HTTP/1.1 Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84MHGXWcO6js7q284IDmaN9I2THAWFpaQ0BFBqiZLoVPIzggtRSi2qXmMKgmSWFTVbRHrorw6-XFB1kLcwFVDnZ76RIhDO5e91X8A3egWudQiARnJfZh8oAT_5IbqI7UiKyyKZyvT__wrphq_wUYvR74Wkxc-sQRNjvnFxs52QF-N3I Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:13:23.838442 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}] Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 7a9c654fc9bc4ad4b530d3f4df5c24c8 Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.840103 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '479fd26a-e2a8-4d55-a760-afbc7de61715'} Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:23.840906 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.843432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Returning 404 to user: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:23.843432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-1239c0ea-b4ef-415e-99bf-5f670f350854 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "DELETE /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 404 len: 111 microversion: 2.1 time: 0.029886 Aug 10 10:13:23.843432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 556/1096] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:13:23 2022] DELETE /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:23.849122 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:23.849790 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] [instance: 479fd26a-e2a8-4d55-a760-afbc7de61715] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:23.856197 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:23.856686 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:23.857130 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:23.857830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:23.858290 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:23.858722 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:23.871759 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] HTTP exception thrown: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Request method failure captured: Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 HTTP/1.1 Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84MHGXWcO6js7q284IDmaN9I2THAWFpaQ0BFBqiZLoVPIzggtRSi2qXmMKgmSWFTVbRHrorw6-XFB1kLcwFVDnZ76RIhDO5e91X8A3egWudQiARnJfZh8oAT_5IbqI7UiKyyKZyvT__wrphq_wUYvR74Wkxc-sQRNjvnFxs52QF-N3I Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:13:23.873277 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aa338ea60ddf4f53a71c19d51b21edb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aa338ea60ddf4f53a71c19d51b21edb8"}]}] Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: aa338ea60ddf4f53a71c19d51b21edb8 Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-TestVolumeBootPattern-705303146 Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 7a9c654fc9bc4ad4b530d3f4df5c24c8 Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-TestVolumeBootPattern-705303146-project Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.874944 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '479fd26a-e2a8-4d55-a760-afbc7de61715'} Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:23.875976 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. Aug 10 10:13:23.878248 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:23.879745 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Returning 404 to user: Instance 479fd26a-e2a8-4d55-a760-afbc7de61715 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:23.879745 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-f4b3f837-a334-4564-937a-281069a2c466 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715" status: 404 len: 111 microversion: 2.1 time: 0.030066 Aug 10 10:13:23.879745 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 541/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:23 2022] GET /compute/v2.1/servers/479fd26a-e2a8-4d55-a760-afbc7de61715 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:25.168815 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-72e9ec6c-f239-411c-915f-81004e4bf240 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] Calling method '.version_select at 0x7f22fbfecaf0>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:25.194532 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-72e9ec6c-f239-411c-915f-81004e4bf240 tempest-TestVolumeBootPattern-705303146 tempest-TestVolumeBootPattern-705303146-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-329800085" status: 202 len: 0 microversion: 2.1 time: 0.029512 Aug 10 10:13:25.195140 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 557/1098] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Aug 10 10:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-329800085 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:13:27.453494 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:27.456246 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:27.462734 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:27.463265 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:27.463713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:27.464422 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:27.464891 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:27.465326 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:27.500223 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-b445c5ca-8af7-45c1-b957-e98a456cb011 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050583 Aug 10 10:13:27.500809 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 542/1099] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:13:27 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:27.512978 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:27.513453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:27.520432 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:27.520908 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:27.521349 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:27.522060 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:27.522529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:27.523030 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:27.552745 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-c150cfa6-7f06-45f5-bd51-67be90ed64ec tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/63747d60-a856-482e-8007-1b1cfc23f2a9" status: 200 len: 194 microversion: 2.1 time: 0.044420 Aug 10 10:13:27.555000 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 558/1100] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 10 10:13:27 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/63747d60-a856-482e-8007-1b1cfc23f2a9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:28.891543 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "062fb1a8-866f-40b1-a5f3-5b20d579c357"}} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:28.894363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:28.900721 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:28.901342 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:28.901790 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:28.902532 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:28.903017 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:28.903454 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:29.148650 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-76df914c-32c8-448a-b0c2-6e711b6a7b72 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "POST /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260525 Aug 10 10:13:29.149287 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 543/1101] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 10 10:13:28 2022] POST /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:35.658521 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:35.660730 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:35.663388 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:35.669222 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:35.669711 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:35.670151 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:35.670841 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:35.671326 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:35.671758 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:35.702512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-6045d6df-276a-4855-b6fb-6055c66f8633 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047876 Aug 10 10:13:35.703076 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 559/1102] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:13:35 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:35.841276 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:35.842142 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:35.844835 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:35.851600 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:35.852084 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:35.852528 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:35.853227 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:35.854051 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:35.854490 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:35.857386 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG dbcounter [-] [117896] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:35.886308 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-0f5b51d7-a6c5-4e33-9ed6-d5e8994819b9 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/63747d60-a856-482e-8007-1b1cfc23f2a9" status: 200 len: 194 microversion: 2.1 time: 0.049579 Aug 10 10:13:35.886890 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 544/1103] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 10 10:13:35 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/63747d60-a856-482e-8007-1b1cfc23f2a9 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 10:13:35.897106 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:35.897607 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:35.903429 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:35.903916 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:35.904358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:35.905051 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:35.905512 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:35.905945 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:35.985716 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lazy-loading 'services' on Instance uuid 78f3c2bc-d770-4ef4-9b0b-10927a406d62 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:13:36.055153 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-f0fc98e1-1110-4370-a893-14ebcd9bebd0 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/63747d60-a856-482e-8007-1b1cfc23f2a9" status: 202 len: 0 microversion: 2.1 time: 0.161811 Aug 10 10:13:36.055938 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 560/1104] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:13:35 2022] DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/63747d60-a856-482e-8007-1b1cfc23f2a9 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:13:37.171968 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:37.172508 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:37.179363 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:37.179855 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:37.180295 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:37.180990 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:37.181449 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:37.181880 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:37.211629 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-d31d5219-8aae-4b31-9388-c72f6d49858e tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/062fb1a8-866f-40b1-a5f3-5b20d579c357" status: 200 len: 194 microversion: 2.1 time: 0.043598 Aug 10 10:13:37.212228 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 545/1105] 10.222.0.20 () {58 vars in 1413 bytes} [Wed Aug 10 10:13:37 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/062fb1a8-866f-40b1-a5f3-5b20d579c357 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:37.223097 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:37.223677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:37.230154 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:37.230634 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:37.231108 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:37.231796 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:37.232252 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:37.232677 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:37.311976 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.objects.instance [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lazy-loading 'services' on Instance uuid 78f3c2bc-d770-4ef4-9b0b-10927a406d62 {{(pid=117895) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 10:13:37.381451 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-cf2ed6d4-dc8e-4148-989e-912127f7eed8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/062fb1a8-866f-40b1-a5f3-5b20d579c357" status: 202 len: 0 microversion: 2.1 time: 0.162263 Aug 10 10:13:37.381982 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 561/1106] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 10 10:13:37 2022] DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments/062fb1a8-866f-40b1-a5f3-5b20d579c357 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:13:38.550724 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:38.553037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:38.559407 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.559897 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.560340 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:38.561031 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.561516 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.561953 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:38.592282 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-a5fbf2ad-5c9d-4063-b87e-2810798682ab tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045939 Aug 10 10:13:38.592828 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 546/1107] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:13:38 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:13:38.702765 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:38.705112 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:38.711059 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.711540 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.712253 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:38.712934 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.713386 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.713808 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:38.742942 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-5f9a9918-3bcf-45be-8ce3-9c034c2d4ea8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044870 Aug 10 10:13:38.743498 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 562/1108] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 10 10:13:38 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 10:13:38.802973 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:38.803614 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:38.809766 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.810320 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.810830 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:38.811468 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.811942 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.812362 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:38.837319 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Going to try to terminate instance {{(pid=117896) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 10:13:38.911116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-de565b52-79cb-4b92-b46e-c8c2686e5ad8 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 204 len: 0 microversion: 2.1 time: 0.111798 Aug 10 10:13:38.911595 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 547/1109] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:13:38 2022] DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 10:13:38.919880 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:38.920577 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:38.927167 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.927658 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.928104 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:38.928801 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:38.929262 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:38.929694 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:39.059650 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:39.067085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-025a6ee3-2d51-41be-81f3-0595b5e2b1f3 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1671 microversion: 2.1 time: 0.151088 Aug 10 10:13:39.067649 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 563/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:38 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:40.088229 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:40.088939 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:40.095353 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:40.095851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:40.096933 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:40.097634 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:40.098099 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:40.098536 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:40.230618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.policy [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117896) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:40.238116 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-890bb315-3b94-461d-8087-5b641c089dbe tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1671 microversion: 2.1 time: 0.154198 Aug 10 10:13:40.238732 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 548/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:40 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:41.259961 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:41.260575 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:41.267143 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:41.267672 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:41.268119 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:41.268822 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:41.269650 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:41.269783 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:41.405667 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.policy [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67a34ddb337649ee948d319b0bf5fab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006aeb4f532425ab423537ebcb2f0b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117895) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 10:13:41.418558 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-2b30aa32-9bec-48e7-a259-25831713de2f tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 200 len: 1671 microversion: 2.1 time: 0.162434 Aug 10 10:13:41.419191 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 564/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:41 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 10:13:41.879507 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [req-9db71641-bab6-4079-af41-2e5aac7d8ec7 req-8752bc5e-0250-41cb-bd97-0bb4c8bcb9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f3c2bc-d770-4ef4-9b0b-10927a406d62", "name": "network-vif-deleted", "tag": "ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8"}]} {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 10:13:41.889713 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9db71641-bab6-4079-af41-2e5aac7d8ec7 req-8752bc5e-0250-41cb-bd97-0bb4c8bcb9ba service nova] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:41.890215 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9db71641-bab6-4079-af41-2e5aac7d8ec7 req-8752bc5e-0250-41cb-bd97-0bb4c8bcb9ba service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:41.890720 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [req-9db71641-bab6-4079-af41-2e5aac7d8ec7 req-8752bc5e-0250-41cb-bd97-0bb4c8bcb9ba service nova] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:41.902786 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.compute.server_external_events [req-9db71641-bab6-4079-af41-2e5aac7d8ec7 req-8752bc5e-0250-41cb-bd97-0bb4c8bcb9ba service nova] Creating event network-vif-deleted:ba585ecd-f412-4224-bc4e-6d9d7b7c8ef8 for instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 on hv-cinder-85083 Aug 10 10:13:41.907834 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [req-9db71641-bab6-4079-af41-2e5aac7d8ec7 req-8752bc5e-0250-41cb-bd97-0bb4c8bcb9ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279478 Aug 10 10:13:41.908534 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 549/1113] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 10 10:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 10:13:42.441165 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:42.441916 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:42.448597 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:42.449094 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:42.449529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:42.450518 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:42.450999 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:42.451428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:42.465126 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] HTTP exception thrown: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Request method failure captured: Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 HTTP/1.1 Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84O-rjX4Bc9oU_jreV1jnpCe_V9e-rM-h1caJKpbQknaUWpktRel5N8_mBvsto-l-wZ2q5a51lX8it2VAFglxEo1S0lsSV9hInXBhvKJMbM-Nsvmr0eArGEX95oGz3IiYn6_Mns6VYbQrADsNlBqREQMfXKTrT6dKvuxKhao0jm5qus Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:13:42.467019 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}] Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 67a34ddb337649ee948d319b0bf5fab3 Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:42.468823 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '78f3c2bc-d770-4ef4-9b0b-10927a406d62'} Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:42.469699 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:42.471327 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:42.472776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Returning 404 to user: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:42.472776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-4fca2213-1663-40ca-aa4d-7840c7995271 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 404 len: 111 microversion: 2.1 time: 0.031939 Aug 10 10:13:42.472776 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 565/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:42 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:42.477811 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-c6e96c25-5138-4eee-9810-8108f9c6b5fd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '.version_select at 0x7f23088e4a60>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:42.497823 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-c6e96c25-5138-4eee-9810-8108f9c6b5fd tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655395363" status: 202 len: 0 microversion: 2.1 time: 0.024027 Aug 10 10:13:42.498412 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 550/1115] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 10 10:13:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655395363 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 10:13:45.380638 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:45.381139 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:45.387529 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:45.388025 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:45.388467 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:45.389162 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:45.389623 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:45.390055 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:45.392704 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG dbcounter [-] [117895] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2 {{(pid=117895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:45.405112 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] HTTP exception thrown: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Request method failure captured: Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 HTTP/1.1 Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84O-rjX4Bc9oU_jreV1jnpCe_V9e-rM-h1caJKpbQknaUWpktRel5N8_mBvsto-l-wZ2q5a51lX8it2VAFglxEo1S0lsSV9hInXBhvKJMbM-Nsvmr0eArGEX95oGz3IiYn6_Mns6VYbQrADsNlBqREQMfXKTrT6dKvuxKhao0jm5qus Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:13:45.406712 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}] Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 67a34ddb337649ee948d319b0bf5fab3 Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.408370 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '78f3c2bc-d770-4ef4-9b0b-10927a406d62'} Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:45.409150 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.410401 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.412098 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Returning 404 to user: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:45.412098 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-56f0d679-809f-4b4e-93fb-63b0c0ebbf92 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 404 len: 111 microversion: 2.1 time: 0.032259 Aug 10 10:13:45.412098 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 566/1116] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:13:45 2022] DELETE /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:45.418037 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:45.418816 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 78f3c2bc-d770-4ef4-9b0b-10927a406d62] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:45.425950 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:45.426444 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:45.426889 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:45.427609 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:45.428074 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:45.428509 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:45.441974 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] HTTP exception thrown: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Request method failure captured: Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 HTTP/1.1 Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84O-rjX4Bc9oU_jreV1jnpCe_V9e-rM-h1caJKpbQknaUWpktRel5N8_mBvsto-l-wZ2q5a51lX8it2VAFglxEo1S0lsSV9hInXBhvKJMbM-Nsvmr0eArGEX95oGz3IiYn6_Mns6VYbQrADsNlBqREQMfXKTrT6dKvuxKhao0jm5qus Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:13:45.443622 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}] Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 67a34ddb337649ee948d319b0bf5fab3 Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.445004 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '78f3c2bc-d770-4ef4-9b0b-10927a406d62'} Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:45.445770 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. Aug 10 10:13:45.447305 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:45.448704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Returning 404 to user: Instance 78f3c2bc-d770-4ef4-9b0b-10927a406d62 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:45.448704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-6ae18e46-af79-4e0f-bd04-aecd4248cd77 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62" status: 404 len: 111 microversion: 2.1 time: 0.031798 Aug 10 10:13:45.448704 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 551/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:45 2022] GET /compute/v2.1/servers/78f3c2bc-d770-4ef4-9b0b-10927a406d62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:46.578977 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:46.579541 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.compute.api [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117895) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:46.585924 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:46.586428 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:46.586876 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:46.587607 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:46.588071 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:46.588509 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG oslo_concurrency.lockutils [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:46.602245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.wsgi [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] HTTP exception thrown: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Request method failure captured: Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: request: DELETE /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 HTTP/1.1 Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept: application/json Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Accept-Encoding: identity Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Connection: close Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Length: 0 Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Content-Type: application/json Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Host: 10.222.0.20 Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Openstack-System-Scope: None Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Auth-Token: gAAAAABi84O-rjX4Bc9oU_jreV1jnpCe_V9e-rM-h1caJKpbQknaUWpktRel5N8_mBvsto-l-wZ2q5a51lX8it2VAFglxEo1S0lsSV9hInXBhvKJMbM-Nsvmr0eArGEX95oGz3IiYn6_Mns6VYbQrADsNlBqREQMfXKTrT6dKvuxKhao0jm5qus Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Id: None Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Domain-Name: None Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Identity-Status: Confirmed Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Is-Admin-Project: True Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Id: default Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Domain-Name: Default Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Project-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Role: reader,member Aug 10 10:13:46.603866 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Roles: reader,member Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}] Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Id: default Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Domain-Name: Default Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Id: 67a34ddb337649ee948d319b0bf5fab3 Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: X-User-Name: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: method: > Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: exception: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.605453 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: action_args: {'id': '984ac747-1c6d-40bf-8a41-b7873c68b603'} Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: {{(pid=117895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:46.606358 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.607962 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.609514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: DEBUG nova.api.openstack.wsgi [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Returning 404 to user: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. {{(pid=117895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:46.609514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO nova.api.openstack.requestlog [None req-0b44a483-8431-46cb-8c75-f7733745bf55 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "DELETE /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 404 len: 111 microversion: 2.1 time: 0.030220 Aug 10 10:13:46.609514 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: [pid: 117895|app: 0|req: 567/1118] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 10 10:13:46 2022] DELETE /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:13:46.614376 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Calling method '>' {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 10:13:46.615028 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.compute.api [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] [instance: 984ac747-1c6d-40bf-8a41-b7873c68b603] Fetching instance by UUID {{(pid=117896) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 10:13:46.621495 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:46.621982 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:46.622424 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:46.623155 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Acquiring lock "e525c749-c7e5-42c0-b469-97038053e8e5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 10:13:46.623618 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 10:13:46.624050 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG oslo_concurrency.lockutils [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Lock "e525c749-c7e5-42c0-b469-97038053e8e5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 10:13:46.637287 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.wsgi [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] HTTP exception thrown: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Request method failure captured: Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: request: GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 HTTP/1.1 Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept: application/json Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Accept-Encoding: identity Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Connection: close Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Length: 0 Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Content-Type: application/json Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Host: 10.222.0.20 Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Openstack-System-Scope: None Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: User-Agent: python-urllib3/1.26.11 Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Auth-Token: gAAAAABi84O-rjX4Bc9oU_jreV1jnpCe_V9e-rM-h1caJKpbQknaUWpktRel5N8_mBvsto-l-wZ2q5a51lX8it2VAFglxEo1S0lsSV9hInXBhvKJMbM-Nsvmr0eArGEX95oGz3IiYn6_Mns6VYbQrADsNlBqREQMfXKTrT6dKvuxKhao0jm5qus Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Id: None Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Domain-Name: None Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Identity-Status: Confirmed Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Is-Admin-Project: True Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Id: default Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Domain-Name: Default Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Project-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Role: reader,member Aug 10 10:13:46.638736 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Roles: reader,member Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d006aeb4f532425ab423537ebcb2f0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d006aeb4f532425ab423537ebcb2f0b1"}]}] Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Id: d006aeb4f532425ab423537ebcb2f0b1 Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1860604897 Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Id: default Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Domain-Name: Default Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Id: 67a34ddb337649ee948d319b0bf5fab3 Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: X-User-Name: tempest-AttachVolumeTestJSON-1860604897-project Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: method: > Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: exception: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.640336 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: action_args: {'id': '984ac747-1c6d-40bf-8a41-b7873c68b603'} Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: {{(pid=117896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 10:13:46.641391 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. Aug 10 10:13:46.642868 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: ERROR nova.api.openstack.wsgi Aug 10 10:13:46.644325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: DEBUG nova.api.openstack.wsgi [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] Returning 404 to user: Instance 984ac747-1c6d-40bf-8a41-b7873c68b603 could not be found. {{(pid=117896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 10:13:46.644325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO nova.api.openstack.requestlog [None req-3bfbebee-8aa9-4a57-b8a1-d4c8fc173f63 tempest-AttachVolumeTestJSON-1860604897 tempest-AttachVolumeTestJSON-1860604897-project] 10.222.0.20 "GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603" status: 404 len: 111 microversion: 2.1 time: 0.030255 Aug 10 10:13:46.644325 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: [pid: 117896|app: 0|req: 552/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 10 10:13:46 2022] GET /compute/v2.1/servers/984ac747-1c6d-40bf-8a41-b7873c68b603 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 10:14:58.944245 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:14:58.944785 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:14:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:16:31.172426 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:16:31.173007 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:16:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:16:44.368239 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:16:44.368838 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Wed Aug 10 10:16:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:16:48.576819 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:16:48.577372 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Wed Aug 10 10:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:16:53.909530 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:16:53.910085 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:16:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:18:12.331195 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:18:12.331851 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Wed Aug 10 10:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:18:18.953683 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:18:18.954188 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:18:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:19:51.180339 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:19:51.181149 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:19:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:20:04.376271 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:20:04.376873 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Wed Aug 10 10:20:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:20:08.584665 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:20:08.585274 dv-cinder-850836-5-iscsi devstack@n-api.service[117896]: Wed Aug 10 10:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 10:20:13.917264 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 10:20:13.917811 dv-cinder-850836-5-iscsi devstack@n-api.service[117895]: Wed Aug 10 10:20:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!